Nov 05 16:00:08 devstack cinder-volume[75821]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 16:00:08 devstack cinder-volume[75821]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 16:00:08 devstack cinder-volume[75821]: we strongly recommend against using it for new projects. Nov 05 16:00:08 devstack cinder-volume[75821]: If you are already using Eventlet, we recommend migrating to a different Nov 05 16:00:08 devstack cinder-volume[75821]: framework. For more detail see Nov 05 16:00:08 devstack cinder-volume[75821]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 16:00:08 devstack cinder-volume[75821]: import eventlet # noqa Nov 05 16:00:11 devstack cinder-volume[75821]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 16:00:11 devstack cinder-volume[75821]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 16:00:11 devstack cinder-volume[75821]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 16:00:12 devstack cinder-volume[75821]: INFO dbcounter [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Registered counter for database cinder Nov 05 16:00:12 devstack cinder-volume[75821]: DEBUG oslo_db.sqlalchemy.engines [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75821) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:00:12 devstack cinder-volume[75821]: DEBUG dbcounter [-] [75821] Writer thread running {{(pid=75821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 16:00:12 devstack cinder-volume[75821]: INFO cinder.rpc [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 16:00:12 devstack cinder-volume[75821]: INFO cinder.rpc [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 16:00:12 devstack cinder-volume[75821]: DEBUG oslo_db.sqlalchemy.engines [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75821) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:00:12 devstack cinder-volume[75821]: INFO cinder.volume.manager [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Determined volume DB was empty at startup. Nov 05 16:00:12 devstack cinder-volume[75821]: DEBUG cinder.volume.manager [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75821) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 16:00:12 devstack cinder-volume[75821]: INFO cinder.volume.manager [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 16:00:12 devstack cinder-volume[75821]: WARNING stevedore.named [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 16:00:12 devstack cinder-volume[75821]: WARNING castellan.key_manager [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 16:00:12 devstack cinder-volume[75821]: WARNING cinder.keymgr.conf_key_mgr [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 16:00:12 devstack cinder-volume[75821]: DEBUG cinder.volume.drivers.lvm [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75821) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 16:00:12 devstack cinder-volume[75821]: DEBUG oslo_concurrency.processutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_concurrency.processutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] CMD "cinder-rtstool verify" returned: 0 in 0.426s {{(pid=75821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_db.sqlalchemy.engines [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75821) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:00:13 devstack cinder-volume[75821]: INFO cinder.rpc [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 16:00:13 devstack cinder-volume[75821]: INFO cinder.rpc [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 16:00:13 devstack cinder-volume[75821]: WARNING stevedore.named [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 16:00:13 devstack cinder-volume[75821]: WARNING castellan.key_manager [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 16:00:13 devstack cinder-volume[75821]: INFO cinder.volume.manager [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_db.sqlalchemy.engines [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75821) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:00:13 devstack cinder-volume[75821]: INFO oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Starting 1 workers Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Started child 75974 {{(pid=75821) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Full set of CONF: {{(pid=75821) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] ******************************************************************************** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Configuration options gathered from: {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 16:00:13 devstack cinder-volume[75974]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] ================================================================================ {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] allow_availability_zone_fallback = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] allow_compression_on_image_upload = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] allowed_direct_url_schemes = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] api_rate_limit = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] auth_strategy = keystone {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] az_cache_duration = 3600 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_availability_zone = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_host = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_stats_polling_interval = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backup_api_class = cinder.backup.api.API {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backup_name_template = backup-%s {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backup_use_same_host = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backup_use_temp_snapshot = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] chap_password = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] chap_username = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_internal_tenant_project_id = 4e2fef409e6343fab72a2cf4ac8b0f55 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_internal_tenant_user_id = 28f1a492e37e42c397a0202faf7e538b {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cloned_volume_same_az = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cluster = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] compression_format = gzip {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] compute_api_class = cinder.compute.nova.API {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] config_dir = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] config_source = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] control_exchange = openstack {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] debug = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] default_availability_zone = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] default_group_type = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] default_volume_type = lvmdriver-1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] disk_geometry = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] driver_client_cert = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] driver_client_cert_key = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] driver_data_namespace = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] driver_ssl_cert_path = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] driver_ssl_cert_verify = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] driver_use_ssl = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] enable_force_upload = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] enable_new_services = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] enable_unsupported_driver = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] enabled_backends = ['lvmdriver-1'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] enforce_multipath_for_image_xfer = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] filter_function = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_api_insecure = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_api_servers = ['http://192.168.122.83/image'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_api_ssl_compression = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_ca_certificates_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_catalog_info = image:glance:publicURL {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_num_retries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance_request_timeout = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] goodness_function = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] graceful_shutdown_timeout = 5 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] group_api_class = cinder.group.api.API {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] host = devstack {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_compress_on_upload = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_conversion_address_space_limit = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_conversion_cpu_limit = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_conversion_disable = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_introspection_address_space_limit = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_introspection_cpu_limit = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_upload_use_cinder_backend = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_upload_use_internal_tenant = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_volume_cache_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_volume_cache_max_count = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75974]: INFO cinder.volume.manager [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] image_volume_cache_max_size_gb = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] init_host_max_objects_retrieval = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] instance_format = [instance: %(uuid)s] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] iscsi_target_flags = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] iscsi_write_cache = on {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] iser_helper = tgtadm {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] iser_ip_address = 192.168.122.83 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] iser_port = 3260 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_color = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_config_append = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_dir = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_options = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_rotate_interval = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_rotate_interval_type = days {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] log_rotation_type = none {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] max_age = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] max_logfile_count = 30 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] max_logfile_size_mb = 200 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] max_over_subscription_ratio = 20.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] message_reap_interval = 86400 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] message_ttl = 2592000 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] migration_create_volume_timeout_secs = 300 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] monkey_patch = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] monkey_patch_modules = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] my_ip = 192.168.122.83 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] no_snapshot_gb_quota = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] num_iser_scan_tries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] num_shell_tries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] num_volume_device_scan_tries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] nvmeof_conn_info_version = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] nvmet_ns_id = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] nvmet_port_id = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] osapi_max_limit = 1000 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] osapi_volume_ext_list = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] osapi_volume_listen = 0.0.0.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] osapi_volume_listen_port = 8776 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] osapi_volume_use_ssl = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] osapi_volume_workers = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] per_volume_size_limit = -1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] periodic_fuzzy_delay = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] periodic_interval = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] project_id_regex = [0-9a-f\-]+ {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] public_endpoint = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] publish_errors = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] quota_backup_gigabytes = 1000 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] quota_backups = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] quota_gigabytes = 1000 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] quota_groups = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] quota_snapshots = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] quota_volumes = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] rate_limit_burst = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] rate_limit_except_level = CRITICAL {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] rate_limit_interval = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] reinit_driver_count = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] replication_device = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] report_discard_supported = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] report_interval = 120 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] reservation_clean_interval = 86400 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] reservation_expire = 86400 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] reserved_image_namespaces = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] reserved_percentage = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] rpc_response_timeout = 120 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] run_external_periodic_tasks = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] scst_target_driver = iscsi {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] scst_target_iqn_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_down_time = 720 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] shell_completion = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] snapshot_name_template = snapshot-%s {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] snapshot_same_host = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] split_loggers = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] state_path = /opt/stack/data/cinder {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] storage_availability_zone = nova {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] storage_protocol = iSCSI {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] syslog_log_facility = LOG_USER {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] target_helper = lioadm {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] target_ip_address = 192.168.122.83 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] target_port = 3260 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] target_protocol = iscsi {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] target_secondary_ip_addresses = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] trace_flags = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] transfer_api_class = cinder.transfer.api.API {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] transport_url = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] until_refresh = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] use_chap_auth = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] use_default_quota_class = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] use_journal = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] use_json = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] use_multipath_for_image_xfer = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] use_stderr = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] use_syslog = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] verify_glance_signatures = enabled {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_api_class = cinder.volume.api.API {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_backend_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_clear = zero {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_clear_ionice = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_clear_size = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_copy_bps_limit = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_dd_blocksize = 1M {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_name_template = volume-%s {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_service_inithost_offload = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volume_usage_audit_period = month {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] zoning_mode = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_concurrency.disable_process_locking = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.auth_section = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.auth_type = password {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.auth_version = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.cache = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.include_service_catalog = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.insecure = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.interface = public {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_password = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcache_username = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.region_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.service_token_roles_required = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.service_type = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.83/identity {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.backend = dogpile.cache.null {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.backend_argument = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.backend_expiration_time = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.config_prefix = cache.oslo {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.debug_cache_backend = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.enable_retry_client = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.enable_socket_keepalive = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.expiration_time = 600 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.hashclient_retry_attempts = 2 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.memcache_dead_retry = 300 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.memcache_pool_maxsize = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.memcache_sasl_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.password = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.proxies = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.redis_db = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.redis_server = localhost:6379 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.retry_attempts = 2 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.retry_delay = 0.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.socket_keepalive_count = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.socket_keepalive_idle = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.socket_keepalive_interval = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.socket_timeout = 1.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.tls_allowed_ciphers = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.tls_cafile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.tls_certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.tls_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.tls_keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cache.username = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] coordination.backend_url = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.asyncio_connection = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.asyncio_slave_connection = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.backend = sqlalchemy {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.connection = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.connection_debug = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.connection_parameters = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.connection_recycle_time = 3600 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.connection_trace = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.db_inc_retry_interval = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.db_max_retries = 20 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.db_max_retry_interval = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.db_retry_interval = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.max_overflow = 50 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.max_pool_size = 5 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.max_retries = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.mysql_wsrep_sync_wait = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.pool_timeout = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.retry_interval = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.slave_connection = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.sqlite_synchronous = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.synchronous_reader = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] database.use_db_reconnect = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_tracing.insecure = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.connection_string = messaging:// {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.es_doc_type = notification {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.es_scroll_size = 10000 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.es_scroll_time = 2m {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.filter_error_trace = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.hmac_keys = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.sentinel_service_name = mymaster {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.socket_timeout = 0.1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.trace_requests = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler.trace_sqlalchemy = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler_jaeger.process_tags = {} {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler_jaeger.service_name_prefix = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] profiler_otlp.service_name_prefix = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.enforce_new_defaults = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.policy_default_rule = default {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.policy_file = policy.yaml {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_policy.remote_timeout = 60.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] privsep_osbrick.group = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] privsep_osbrick.helper_command = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] privsep_osbrick.user = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_sys_admin.group = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_sys_admin.helper_command = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] cinder_sys_admin.user = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.auth_section = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.auth_type = password {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.cafile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.collect_timing = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.insecure = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.send_service_user_token = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.split_loggers = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.timeout = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.tls_ciphers = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] service_user.tls_min_version = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.auth_section = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.auth_type = password {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.collect_timing = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.insecure = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.region_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.split_loggers = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.timeout = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.tls_ciphers = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] glance.tls_min_version = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.backend_availability_zone = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.chap_password = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.chap_username = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.disk_geometry = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.driver_client_cert = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.driver_client_cert_key = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.driver_data_namespace = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.driver_use_ssl = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.extra_capabilities = {} {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.filter_function = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.goodness_function = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack sudo[75978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.iscsi_target_flags = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.iscsi_write_cache = on {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.iser_helper = tgtadm {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.iser_ip_address = 192.168.122.83 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.iser_port = 3260 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack sudo[75978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.lvm_mirrors = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.lvm_share_target = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.lvm_type = auto {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.num_shell_tries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.replication_device = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.report_discard_supported = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.reserved_percentage = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.target_helper = tgtadm {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.target_ip_address = 192.168.122.83 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.target_port = 3260 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.target_protocol = iscsi {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.trace_flags = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.unique_fqdn_network = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.use_chap_auth = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_backend_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_clear = zero {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_clear_ionice = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_clear_size = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volume_group = cinder-volumes {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_reports.file_event_handler = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_reports.log_dir = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.backend_host = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.chap_password = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.chap_username = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.chiscsi_conf = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.disk_geometry = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.driver_client_cert = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.driver_use_ssl = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.extra_capabilities = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.filter_function = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.goodness_function = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.iser_helper = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.iser_ip_address = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.iser_port = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.lvm_conf_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.lvm_mirrors = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.lvm_share_target = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.lvm_type = auto {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.num_shell_tries = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.nvmet_port_id = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.replication_device = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.report_discard_supported = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.reserved_percentage = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.scst_target_driver = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.storage_protocol = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.target_helper = lioadm {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.target_ip_address = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.target_port = 3260 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.target_protocol = iscsi {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.trace_flags = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.use_chap_auth = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_clear = zero {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_clear_size = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] lvmdriver-1.volumes_dir = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.ssl = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.ssl_version = {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_notifications.driver = [] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_notifications.retry = -1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] key_manager.fixed_key = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.barbican_api_version = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.barbican_endpoint = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.barbican_endpoint_type = public {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.barbican_region_name = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.cafile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.collect_timing = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.insecure = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.number_of_retries = 60 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.retry_delay = 1 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.send_service_user_token = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.split_loggers = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.timeout = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.tls_ciphers = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.tls_min_version = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.verify_ssl = True {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican.verify_ssl_path = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.auth_section = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.auth_type = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.cafile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.certfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.collect_timing = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.insecure = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.keyfile = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.split_loggers = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.timeout = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.tls_ciphers = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] barbican_service_user.tls_min_version = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.approle_role_id = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.approle_secret_id = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.auth_method = approle {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.auth_path = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.kv_mountpoint = secret {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.kv_path = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.kv_version = 2 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.namespace = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.root_token_id = **** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.ssl_ca_crt_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.timeout = 60.0 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.token_file = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.token_role = None {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.use_ssl = False {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:00:13 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] ******************************************************************************** {{(pid=75821) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 16:00:14 devstack sudo[75978]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.364s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:14 devstack sudo[75986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:14 devstack sudo[75986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:14 devstack sudo[75986]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.351s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:00:14 devstack cinder-volume[75974]: INFO cinder.brick.local_dev.lvm [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:14 devstack sudo[75990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:00:14 devstack sudo[75990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:14 devstack sudo[75990]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG cinder.brick.local_dev.lvm [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75974) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 16:00:14 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:14 devstack sudo[76024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:14 devstack sudo[76024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:15 devstack sudo[76024]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:15 devstack sudo[76249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:15 devstack sudo[76249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:15 devstack sudo[76249]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:15 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 16:00:15 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:15 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.295s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:15 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:15 devstack sudo[76453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:00:15 devstack sudo[76453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:16 devstack sudo[76453]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:16 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:16 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:16 devstack sudo[76524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:00:16 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:16 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:16 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:16 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:16 devstack sudo[76604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:00:16 devstack sudo[76604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:16 devstack sudo[76604]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:16 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:16 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:16 devstack sudo[76613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:16 devstack sudo[76613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:17 devstack sudo[76613]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:17 devstack sudo[76694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:17 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:17 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:17 devstack cinder-volume[75974]: INFO cinder.volume.drivers.lvm [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:17 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:17 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:17 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG cinder.volume.drivers.lvm [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Updating volume stats {{(pid=75974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:17 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:00:17 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:17 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:17 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:17 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:00:17 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:18 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:18 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:18 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:18 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:18 devstack sudo[76802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:00:18 devstack sudo[76802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:18 devstack sudo[76802]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:18 devstack cinder-volume[75974]: INFO cinder.volume.driver [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG cinder.volume.driver [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75974) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG oslo_db.sqlalchemy.engines [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writer thread running {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG cinder.db.api [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Building query based on filter {{(pid=75974) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG cinder.image.image_utils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75974) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1330}} Nov 05 16:00:18 devstack cinder-volume[75974]: INFO cinder.keymgr.migration [None req-905f347a-b354-45b6-bc1e-a332ab3b7f29 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG cinder.volume.drivers.lvm [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Updating volume stats {{(pid=75974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 16:00:18 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:18 devstack sudo[76806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:00:18 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:19 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:19 devstack sudo[76809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:00:19 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:19 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:19 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:19 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:19 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:19 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:00:19 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:19 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG cinder.manager [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Notifying Schedulers of capabilities ... {{(pid=75974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:00:19 devstack cinder-volume[75974]: INFO cinder.volume.manager [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Driver initialization completed successfully. Nov 05 16:00:19 devstack cinder-volume[75974]: INFO cinder.manager [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Initiating service 2 cleanup Nov 05 16:00:19 devstack cinder-volume[75974]: INFO cinder.manager [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Service 2 cleanup completed. Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG cinder.service [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Creating RPC server for service cinder-volume {{(pid=75974) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 16:00:19 devstack cinder-volume[75974]: DEBUG cinder.service [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75974) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 16:00:19 devstack cinder-volume[75974]: INFO cinder.volume.manager [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG cinder.volume.drivers.lvm [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Updating volume stats {{(pid=75974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:20 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:00:20 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:20 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:20 devstack sudo[76824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:00:20 devstack sudo[76824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:20 devstack sudo[76824]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:20 devstack sudo[76830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:00:20 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:20 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:20 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:00:20 devstack sudo[76833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:00:20 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:00:21 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root Nov 05 16:00:21 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:00:21 devstack cinder-volume[75974]: INFO cinder.volume.manager [None req-84a29c61-2cfd-479a-a5e3-8a4d39ee9008 None None] Driver post RPC initialization completed successfully. Nov 05 16:00:23 devstack cinder-volume[75821]: DEBUG dbcounter [-] [75821] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:00:31 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:00:31 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:01:07 devstack cinder-volume[75974]: DEBUG oslo_service.periodic_task [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running periodic task VolumeManager._thread_info {{(pid=75974) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:01:07 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread count: 6 {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:01:07 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread info: [<_MainThread(MainThread, started 137102329106560)>, , , , , ] {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_service.periodic_task [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75974) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG cinder.volume.drivers.lvm [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Updating volume stats {{(pid=75974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:02:07 devstack sudo[81969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:02:07 devstack sudo[81969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:02:07 devstack sudo[81969]: pam_unix(sudo:session): session closed for user root Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:02:07 devstack sudo[81972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:02:07 devstack sudo[81972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:02:07 devstack sudo[81972]: pam_unix(sudo:session): session closed for user root Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:02:07 devstack sudo[81991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:02:07 devstack sudo[81991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:02:07 devstack sudo[81991]: pam_unix(sudo:session): session closed for user root Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:02:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:02:07 devstack sudo[81995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:02:07 devstack sudo[81995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:02:08 devstack sudo[81995]: pam_unix(sudo:session): session closed for user root Nov 05 16:02:08 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:02:08 devstack cinder-volume[75974]: DEBUG cinder.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Notifying Schedulers of capabilities ... {{(pid=75974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:02:08 devstack cinder-volume[75974]: DEBUG oslo_service.periodic_task [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running periodic task VolumeManager._thread_info {{(pid=75974) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:02:08 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread count: 6 {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:02:08 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread info: [<_MainThread(MainThread, started 137102329106560)>, , , , , ] {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:02:31 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writing DB stats cinder:SELECT=1 {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:02:31 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writing DB stats cinder:UPDATE=1 {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_service.periodic_task [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75974) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG cinder.volume.drivers.lvm [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Updating volume stats {{(pid=75974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:03:07 devstack sudo[83989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:03:07 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:03:07 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:03:07 devstack sudo[84005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:03:07 devstack sudo[84005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:03:07 devstack sudo[84005]: pam_unix(sudo:session): session closed for user root Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:03:07 devstack sudo[84010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:03:07 devstack sudo[84010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:03:07 devstack sudo[84010]: pam_unix(sudo:session): session closed for user root Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:03:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:03:07 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:03:07 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:03:08 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Nov 05 16:03:08 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:03:08 devstack cinder-volume[75974]: DEBUG cinder.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Notifying Schedulers of capabilities ... {{(pid=75974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:03:08 devstack cinder-volume[75974]: DEBUG oslo_service.periodic_task [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running periodic task VolumeManager._thread_info {{(pid=75974) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:03:08 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread count: 6 {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:03:08 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread info: [<_MainThread(MainThread, started 137102329106560)>, , , , , ] {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_service.periodic_task [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75974) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG cinder.volume.drivers.lvm [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Updating volume stats {{(pid=75974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:07 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 16:04:07 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:07 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:07 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:04:07 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:07 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:07 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 16:04:07 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:07 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:07 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:07 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 16:04:07 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:08 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:08 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:08 devstack cinder-volume[75974]: DEBUG cinder.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Notifying Schedulers of capabilities ... {{(pid=75974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:04:08 devstack cinder-volume[75974]: DEBUG oslo_service.periodic_task [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] Running periodic task VolumeManager._thread_info {{(pid=75974) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:04:08 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread count: 6 {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:04:08 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-5059cf93-c57b-4005-a4dc-b3c118075bd4 None None] thread info: [<_MainThread(MainThread, started 137102329106560)>, , , , , ] {{(pid=75974) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:04:31 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writing DB stats cinder:SELECT=1 {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:04:31 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writing DB stats cinder:UPDATE=1 {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:04:32 devstack cinder-volume[75821]: INFO oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Caught SIGTERM, stopping children Nov 05 16:04:32 devstack cinder-volume[75821]: DEBUG oslo_concurrency.lockutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Acquiring lock "singleton_lock" {{(pid=75821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 16:04:32 devstack cinder-volume[75821]: DEBUG oslo_concurrency.lockutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Acquired lock "singleton_lock" {{(pid=75821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 16:04:32 devstack cinder-volume[75821]: DEBUG oslo_concurrency.lockutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Releasing lock "singleton_lock" {{(pid=75821) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 16:04:32 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Stop services. {{(pid=75821) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 16:04:32 devstack cinder-volume[75821]: DEBUG oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Killing children. {{(pid=75821) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 16:04:32 devstack cinder-volume[75821]: INFO oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Waiting on 1 children to exit Nov 05 16:04:34 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Acquiring lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 16:04:34 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Acquired lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 16:04:34 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Releasing lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 16:04:34 devstack cinder-volume[75974]: WARNING amqp [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 16:04:35 devstack cinder-volume[75974]: WARNING amqp [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 16:04:35 devstack cinder-volume[75821]: INFO oslo_service.backend._eventlet.service [None req-e160165e-d076-46c2-b4ed-c9408cf5a33c None None] Child 75974 exited with status 0 Nov 05 16:04:35 devstack cinder-volume[86053]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 16:04:35 devstack cinder-volume[86053]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 16:04:35 devstack cinder-volume[86053]: we strongly recommend against using it for new projects. Nov 05 16:04:35 devstack cinder-volume[86053]: If you are already using Eventlet, we recommend migrating to a different Nov 05 16:04:35 devstack cinder-volume[86053]: framework. For more detail see Nov 05 16:04:35 devstack cinder-volume[86053]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 16:04:35 devstack cinder-volume[86053]: import eventlet # noqa Nov 05 16:04:37 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 16:04:37 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 16:04:37 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 16:04:38 devstack cinder-volume[86053]: INFO dbcounter [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Registered counter for database cinder Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_db.sqlalchemy.engines [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86053) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG dbcounter [-] [86053] Writer thread running {{(pid=86053) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 16:04:38 devstack cinder-volume[86053]: INFO cinder.rpc [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 16:04:38 devstack cinder-volume[86053]: INFO cinder.rpc [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_db.sqlalchemy.engines [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86053) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:38 devstack cinder-volume[86053]: INFO cinder.volume.manager [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Determined volume DB was empty at startup. Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG cinder.volume.manager [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86053) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 16:04:38 devstack cinder-volume[86053]: INFO cinder.volume.manager [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 16:04:38 devstack cinder-volume[86053]: WARNING stevedore.named [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 16:04:38 devstack cinder-volume[86053]: WARNING castellan.key_manager [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 16:04:38 devstack cinder-volume[86053]: WARNING cinder.keymgr.conf_key_mgr [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 16:04:38 devstack cinder-volume[86053]: INFO cinder.volume.manager [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_db.sqlalchemy.engines [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86053) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:38 devstack cinder-volume[86053]: INFO oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Starting 1 workers Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Started child 86273 {{(pid=86053) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Full set of CONF: {{(pid=86053) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] ******************************************************************************** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Configuration options gathered from: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] ================================================================================ {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] allow_availability_zone_fallback = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] allow_compression_on_image_upload = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] allowed_direct_url_schemes = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] api_rate_limit = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] auth_strategy = keystone {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_host = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_stats_polling_interval = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backup_api_class = cinder.backup.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backup_name_template = backup-%s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86273]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backup_use_same_host = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backup_use_temp_snapshot = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] chap_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] chap_username = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_internal_tenant_project_id = 4e2fef409e6343fab72a2cf4ac8b0f55 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_internal_tenant_user_id = 28f1a492e37e42c397a0202faf7e538b {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cluster = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] compression_format = gzip {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] compute_api_class = cinder.compute.nova.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] config_dir = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] config_source = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] control_exchange = openstack {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] debug = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] default_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] default_group_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] default_volume_type = QuobyteHD {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] disk_geometry = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] driver_client_cert = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] driver_client_cert_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] driver_data_namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] driver_ssl_cert_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] driver_ssl_cert_verify = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] driver_use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] enable_new_services = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] enable_unsupported_driver = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] enabled_backends = ['QuobyteHD'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] enforce_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] filter_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_api_insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_api_servers = ['http://192.168.122.83/image'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_api_ssl_compression = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_ca_certificates_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_catalog_info = image:glance:publicURL {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_num_retries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance_request_timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] goodness_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] graceful_shutdown_timeout = 5 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] group_api_class = cinder.group.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] host = devstack {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_compress_on_upload = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_conversion_address_space_limit = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_conversion_cpu_limit = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_conversion_disable = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_introspection_address_space_limit = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_introspection_cpu_limit = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_upload_use_cinder_backend = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_upload_use_internal_tenant = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_volume_cache_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_volume_cache_max_count = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] image_volume_cache_max_size_gb = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] init_host_max_objects_retrieval = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] instance_format = [instance: %(uuid)s] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] iscsi_target_flags = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] iscsi_write_cache = on {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] iser_helper = tgtadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] iser_ip_address = 192.168.122.83 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] iser_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_color = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_config_append = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_dir = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_options = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_rotate_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_rotate_interval_type = days {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] log_rotation_type = none {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] max_age = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] max_logfile_count = 30 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] max_logfile_size_mb = 200 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] max_over_subscription_ratio = 20.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] message_reap_interval = 86400 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] message_ttl = 2592000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] migration_create_volume_timeout_secs = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] monkey_patch = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] monkey_patch_modules = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] my_ip = 192.168.122.83 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] no_snapshot_gb_quota = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] num_iser_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] num_shell_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] num_volume_device_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] nvmeof_conn_info_version = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] nvmet_ns_id = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] nvmet_port_id = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] osapi_max_limit = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] osapi_volume_ext_list = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] osapi_volume_listen_port = 8776 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] osapi_volume_use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] osapi_volume_workers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] per_volume_size_limit = -1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] periodic_fuzzy_delay = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] periodic_interval = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] public_endpoint = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] publish_errors = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] quota_backup_gigabytes = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] quota_backups = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] quota_gigabytes = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] quota_groups = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] quota_snapshots = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] quota_volumes = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] rate_limit_burst = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] rate_limit_except_level = CRITICAL {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] rate_limit_interval = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] reinit_driver_count = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] replication_device = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] report_discard_supported = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] report_interval = 120 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] reservation_clean_interval = 86400 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] reservation_expire = 86400 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] reserved_image_namespaces = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] reserved_percentage = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] rpc_response_timeout = 120 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] run_external_periodic_tasks = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] scst_target_driver = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] scst_target_iqn_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_down_time = 720 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] shell_completion = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] snapshot_name_template = snapshot-%s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] state_path = /opt/stack/data/cinder {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] storage_availability_zone = nova {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] storage_protocol = iSCSI {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] syslog_log_facility = LOG_USER {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] target_helper = lioadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] target_ip_address = 192.168.122.83 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] target_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] target_protocol = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] target_secondary_ip_addresses = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] trace_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] transport_url = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] until_refresh = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] use_chap_auth = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] use_default_quota_class = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] use_journal = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] use_json = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] use_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] use_stderr = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] use_syslog = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] verify_glance_signatures = enabled {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_api_class = cinder.volume.api.API {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_backend_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_clear = zero {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_clear_ionice = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_clear_size = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_copy_bps_limit = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_dd_blocksize = 1M {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_name_template = volume-%s {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_service_inithost_offload = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volume_usage_audit_period = month {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] zoning_mode = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_concurrency.disable_process_locking = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.remotefs [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86273) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.auth_type = password {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.auth_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.cache = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.include_service_catalog = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.interface = public {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcache_username = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.region_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.service_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.83/identity {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.backend = dogpile.cache.null {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.backend_argument = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.backend_expiration_time = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.config_prefix = cache.oslo {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.debug_cache_backend = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.enable_retry_client = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.enable_socket_keepalive = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.expiration_time = 600 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.hashclient_retry_attempts = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.memcache_dead_retry = 300 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.memcache_pool_maxsize = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.memcache_sasl_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.proxies = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.redis_db = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.redis_server = localhost:6379 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.retry_attempts = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.retry_delay = 0.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.socket_keepalive_count = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.socket_keepalive_idle = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.socket_keepalive_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.socket_timeout = 1.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.tls_allowed_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.tls_cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.tls_certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.tls_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.tls_keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cache.username = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] coordination.backend_url = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.asyncio_connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.asyncio_slave_connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.backend = sqlalchemy {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.connection_debug = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.connection_parameters = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.connection_recycle_time = 3600 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.connection_trace = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.db_inc_retry_interval = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.db_max_retries = 20 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.db_max_retry_interval = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.db_retry_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.max_overflow = 50 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.max_pool_size = 5 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.max_retries = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.mysql_wsrep_sync_wait = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:38 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.pool_timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.retry_interval = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.slave_connection = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.sqlite_synchronous = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.synchronous_reader = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] database.use_db_reconnect = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_tracing.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.connection_string = messaging:// {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.es_doc_type = notification {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.es_scroll_size = 10000 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.es_scroll_time = 2m {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.filter_error_trace = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.hmac_keys = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.sentinel_service_name = mymaster {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.socket_timeout = 0.1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.trace_requests = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler.trace_sqlalchemy = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler_jaeger.process_tags = {} {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler_jaeger.service_name_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] profiler_otlp.service_name_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.enforce_new_defaults = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.policy_default_rule = default {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.policy_file = policy.yaml {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] privsep_osbrick.group = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] privsep_osbrick.helper_command = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] privsep_osbrick.user = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_sys_admin.group = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_sys_admin.helper_command = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] cinder_sys_admin.user = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.auth_type = password {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.send_service_user_token = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.tls_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] service_user.tls_min_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.auth_type = password {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.region_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.tls_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] glance.tls_min_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.backend_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.chap_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.chap_username = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.disk_geometry = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.driver_client_cert = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.driver_client_cert_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.driver_data_namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.driver_use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.extra_capabilities = {} {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.filter_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.goodness_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.iscsi_target_flags = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.iscsi_write_cache = on {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.iser_helper = tgtadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.iser_ip_address = 192.168.122.83 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.iser_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_host = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_login = admin {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_mount_options = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_private_key = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_share_path = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.num_shell_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.quobyte_volume_url = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.replication_device = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.report_discard_supported = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.reserved_percentage = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.target_helper = tgtadm {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.target_ip_address = 192.168.122.83 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.target_port = 3260 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.target_protocol = iscsi {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.trace_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.unique_fqdn_network = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.use_chap_auth = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_backend_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_clear = zero {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_clear_ionice = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_clear_size = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86273) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 16:04:39 devstack cinder-volume[86273]: WARNING cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 16:04:39 devstack cinder-volume[86273]: WARNING cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Running cmd (subprocess): mount.quobyte {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_reports.file_event_handler = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_reports.log_dir = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.backend_availability_zone = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.backend_host = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.chap_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.chap_username = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.chiscsi_conf = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.disk_geometry = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.driver_client_cert = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.driver_data_namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.driver_use_ssl = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.extra_capabilities = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.filter_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.goodness_function = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.iser_helper = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.iser_ip_address = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.iser_port = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.iser_target_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_host = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_login = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_mount_options = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_password = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_private_key = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_share_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_ssh_port = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.num_shell_tries = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.nvmet_port_id = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.replication_device = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.report_discard_supported = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.reserved_percentage = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.scst_target_driver = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.storage_protocol = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.target_helper = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.target_ip_address = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.target_port = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.target_prefix = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.target_protocol = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.trace_flags = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.use_chap_auth = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_clear = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_clear_size = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] QuobyteHD.volumes_dir = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_notifications.driver = [] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_notifications.retry = -1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] key_manager.fixed_key = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.barbican_api_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.barbican_endpoint = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.barbican_endpoint_type = public {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.barbican_region_name = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.number_of_retries = 60 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.retry_delay = 1 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.send_service_user_token = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.tls_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.tls_min_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.verify_ssl = True {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican.verify_ssl_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.auth_section = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.auth_type = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.cafile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.certfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.collect_timing = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.insecure = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.keyfile = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.split_loggers = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.timeout = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.tls_ciphers = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] barbican_service_user.tls_min_version = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.approle_role_id = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.approle_secret_id = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.auth_method = approle {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.auth_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.kv_mountpoint = secret {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.kv_path = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.kv_version = 2 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.namespace = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.root_token_id = **** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.ssl_ca_crt_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.timeout = 60.0 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.token_file = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.token_role = None {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.use_ssl = False {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:39 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] ******************************************************************************** {{(pid=86053) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 16:04:39 devstack quobyte-client[86276]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 16:04:39 devstack quobyte-client[86276]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:04:39 devstack cinder-volume[86273]: INFO cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff ... Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 -c /etc/quobyte/client-cinder.cfg {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:39 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 -c /etc/quobyte/client-cinder.cfg Nov 05 16:04:39 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:39 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.393s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:39 devstack cinder-volume[86273]: INFO cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff succeeded Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.403s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:39 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:04:39 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:39 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.245s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:39 devstack cinder-volume[86273]: INFO cinder.volume.driver [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Driver hasn't implemented _init_vendor_properties() Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.volume.driver [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.458740234375, 'free_capacity_gb': 1773.458740234375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86273) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG dbcounter [-] [86273] Writer thread running {{(pid=86273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.db.api [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Building query based on filter {{(pid=86273) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.image.image_utils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86273) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1330}} Nov 05 16:04:39 devstack cinder-volume[86273]: INFO cinder.keymgr.migration [None req-852995f4-58ab-4ccc-9c4e-8bb93a9d5b61 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:04:39 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:39 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:04:39 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:40 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.234s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG cinder.manager [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Notifying Schedulers of capabilities ... {{(pid=86273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:04:40 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Driver initialization completed successfully. Nov 05 16:04:40 devstack cinder-volume[86273]: INFO cinder.manager [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Initiating service 3 cleanup Nov 05 16:04:40 devstack cinder-volume[86273]: INFO cinder.manager [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Service 3 cleanup completed. Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG cinder.service [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Creating RPC server for service cinder-volume {{(pid=86273) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG cinder.service [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86273) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 16:04:40 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:40 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:04:40 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:40 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:40 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.250s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:40 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-9d810252-4a97-4de1-936b-25b52cdb800e None None] Driver post RPC initialization completed successfully. Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG cinder.volume.drivers.quobyte [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:45 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:04:45 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:45 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG oslo_concurrency.processutils [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.217s {{(pid=86273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:45 devstack cinder-volume[86273]: DEBUG cinder.manager [None req-8e380c72-920f-488a-9e25-c53ba561cf6b None None] Notifying Schedulers of capabilities ... {{(pid=86273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:04:48 devstack cinder-volume[86053]: INFO oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Caught SIGTERM, stopping children Nov 05 16:04:48 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Acquiring lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 16:04:48 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Acquired lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 16:04:48 devstack cinder-volume[86053]: DEBUG oslo_concurrency.lockutils [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Releasing lock "singleton_lock" {{(pid=86053) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 16:04:48 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Stop services. {{(pid=86053) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 16:04:48 devstack cinder-volume[86053]: DEBUG oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Killing children. {{(pid=86053) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 16:04:48 devstack cinder-volume[86053]: INFO oslo_service.backend._eventlet.service [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Waiting on 1 children to exit Nov 05 16:04:50 devstack cinder-volume[86273]: DEBUG dbcounter [-] [86273] Writing DB stats cinder:SELECT=4 {{(pid=86273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:04:50 devstack cinder-volume[86273]: DEBUG dbcounter [-] [86273] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:04:53 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 05 16:04:53 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Acquiring lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 16:04:53 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Acquired lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 16:04:53 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Releasing lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 16:04:53 devstack cinder-volume[86273]: WARNING amqp [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 16:04:53 devstack cinder-volume[86273]: WARNING amqp [None req-6b596741-1e8a-4c36-a25c-99d0fe136e6a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 16:04:54 devstack cinder-volume[86618]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 16:04:54 devstack cinder-volume[86618]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 16:04:54 devstack cinder-volume[86618]: we strongly recommend against using it for new projects. Nov 05 16:04:54 devstack cinder-volume[86618]: If you are already using Eventlet, we recommend migrating to a different Nov 05 16:04:54 devstack cinder-volume[86618]: framework. For more detail see Nov 05 16:04:54 devstack cinder-volume[86618]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 16:04:54 devstack cinder-volume[86618]: import eventlet # noqa Nov 05 16:04:56 devstack cinder-volume[86618]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 16:04:56 devstack cinder-volume[86618]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 16:04:56 devstack cinder-volume[86618]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 16:04:57 devstack cinder-volume[86618]: INFO dbcounter [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Registered counter for database cinder Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_db.sqlalchemy.engines [None req-02126905-a76e-4761-8f1b-db97f748529f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG dbcounter [-] [86618] Writer thread running {{(pid=86618) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 16:04:57 devstack cinder-volume[86618]: INFO cinder.rpc [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 16:04:57 devstack cinder-volume[86618]: INFO cinder.rpc [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_db.sqlalchemy.engines [None req-02126905-a76e-4761-8f1b-db97f748529f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:57 devstack cinder-volume[86618]: INFO cinder.volume.manager [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Determined volume DB was empty at startup. Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG cinder.volume.manager [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86618) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 16:04:57 devstack cinder-volume[86618]: WARNING stevedore.named [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 16:04:57 devstack cinder-volume[86618]: WARNING castellan.key_manager [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 16:04:57 devstack cinder-volume[86618]: WARNING cinder.keymgr.conf_key_mgr [None req-02126905-a76e-4761-8f1b-db97f748529f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 16:04:57 devstack cinder-volume[86618]: INFO cinder.volume.manager [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_db.sqlalchemy.engines [None req-02126905-a76e-4761-8f1b-db97f748529f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:57 devstack cinder-volume[86618]: INFO oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Starting 1 workers Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Started child 86924 {{(pid=86618) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Full set of CONF: {{(pid=86618) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] ******************************************************************************** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] Configuration options gathered from: {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] ================================================================================ {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] allow_availability_zone_fallback = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] allow_compression_on_image_upload = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] allowed_direct_url_schemes = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] api_rate_limit = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] auth_strategy = keystone {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_availability_zone = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86924]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_host = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_stats_polling_interval = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backup_api_class = cinder.backup.api.API {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backup_name_template = backup-%s {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backup_use_same_host = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backup_use_temp_snapshot = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] chap_password = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] chap_username = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_internal_tenant_project_id = 4e2fef409e6343fab72a2cf4ac8b0f55 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_internal_tenant_user_id = 28f1a492e37e42c397a0202faf7e538b {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cluster = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] compression_format = gzip {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] compute_api_class = cinder.compute.nova.API {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] config_dir = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] config_source = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] control_exchange = openstack {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] debug = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] default_availability_zone = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] default_group_type = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] default_volume_type = QuobyteHD {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] disk_geometry = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] driver_client_cert = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] driver_client_cert_key = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] driver_data_namespace = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] driver_ssl_cert_path = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] driver_ssl_cert_verify = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] driver_use_ssl = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] enable_new_services = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] enable_unsupported_driver = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] enabled_backends = ['QuobyteHD'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] enforce_multipath_for_image_xfer = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] filter_function = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_api_insecure = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_api_servers = ['http://192.168.122.83/image'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_api_ssl_compression = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_ca_certificates_file = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_catalog_info = image:glance:publicURL {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_num_retries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance_request_timeout = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] goodness_function = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] graceful_shutdown_timeout = 5 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] group_api_class = cinder.group.api.API {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] host = devstack {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_compress_on_upload = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_conversion_address_space_limit = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_conversion_cpu_limit = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_conversion_disable = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_introspection_address_space_limit = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_introspection_cpu_limit = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_upload_use_cinder_backend = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_upload_use_internal_tenant = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_volume_cache_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_volume_cache_max_count = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] image_volume_cache_max_size_gb = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] init_host_max_objects_retrieval = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] instance_format = [instance: %(uuid)s] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] iscsi_target_flags = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] iscsi_write_cache = on {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] iser_helper = tgtadm {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] iser_ip_address = 192.168.122.83 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] iser_port = 3260 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_color = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_config_append = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_dir = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_file = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_options = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_rotate_interval = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_rotate_interval_type = days {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] log_rotation_type = none {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] max_age = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] max_logfile_count = 30 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] max_logfile_size_mb = 200 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] max_over_subscription_ratio = 20.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] message_reap_interval = 86400 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] message_ttl = 2592000 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] migration_create_volume_timeout_secs = 300 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] monkey_patch = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] monkey_patch_modules = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] my_ip = 192.168.122.83 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] no_snapshot_gb_quota = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] num_iser_scan_tries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] num_shell_tries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] num_volume_device_scan_tries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] nvmeof_conn_info_version = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] nvmet_ns_id = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] nvmet_port_id = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] osapi_max_limit = 1000 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] osapi_volume_ext_list = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] osapi_volume_listen_port = 8776 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] osapi_volume_use_ssl = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] osapi_volume_workers = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] per_volume_size_limit = -1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] periodic_fuzzy_delay = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] periodic_interval = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] public_endpoint = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] publish_errors = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] quota_backup_gigabytes = 1000 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] quota_backups = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] quota_gigabytes = 1000 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] quota_groups = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] quota_snapshots = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] quota_volumes = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] rate_limit_burst = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] rate_limit_except_level = CRITICAL {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] rate_limit_interval = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] reinit_driver_count = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] replication_device = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] report_discard_supported = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] report_interval = 120 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] reservation_clean_interval = 86400 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] reservation_expire = 86400 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] reserved_image_namespaces = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] reserved_percentage = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] rpc_response_timeout = 120 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] run_external_periodic_tasks = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 16:04:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86924) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] scst_target_driver = iscsi {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] scst_target_iqn_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_down_time = 720 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] shell_completion = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] snapshot_name_template = snapshot-%s {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] split_loggers = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] state_path = /opt/stack/data/cinder {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] storage_availability_zone = nova {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] storage_protocol = iSCSI {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] syslog_log_facility = LOG_USER {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] target_helper = lioadm {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] target_ip_address = 192.168.122.83 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] target_port = 3260 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] target_protocol = iscsi {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] target_secondary_ip_addresses = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] trace_flags = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] transport_url = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] until_refresh = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] use_chap_auth = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] use_default_quota_class = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] use_journal = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] use_json = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] use_multipath_for_image_xfer = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] use_stderr = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] use_syslog = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] verify_glance_signatures = enabled {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_api_class = cinder.volume.api.API {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_backend_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_clear = zero {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_clear_ionice = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_clear_size = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_copy_bps_limit = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_dd_blocksize = 1M {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_name_template = volume-%s {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_service_inithost_offload = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volume_usage_audit_period = month {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] zoning_mode = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_concurrency.disable_process_locking = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.auth_section = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.auth_type = password {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.auth_version = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.cache = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.include_service_catalog = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.insecure = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.interface = public {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_password = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcache_username = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.region_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.service_type = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.83/identity {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.backend = dogpile.cache.null {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.backend_argument = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.backend_expiration_time = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.config_prefix = cache.oslo {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.debug_cache_backend = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.enable_retry_client = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.enable_socket_keepalive = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.expiration_time = 600 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.hashclient_retry_attempts = 2 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.memcache_dead_retry = 300 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.memcache_pool_maxsize = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.memcache_sasl_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.password = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.proxies = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.redis_db = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.redis_server = localhost:6379 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.retry_attempts = 2 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.retry_delay = 0.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.socket_keepalive_count = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.socket_keepalive_idle = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.socket_keepalive_interval = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.socket_timeout = 1.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.tls_allowed_ciphers = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.tls_cafile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.tls_certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.tls_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.tls_keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cache.username = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] coordination.backend_url = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.asyncio_connection = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.asyncio_slave_connection = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.backend = sqlalchemy {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.connection = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.connection_debug = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.connection_parameters = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.connection_recycle_time = 3600 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.connection_trace = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.db_inc_retry_interval = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.db_max_retries = 20 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.db_max_retry_interval = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.db_retry_interval = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.max_overflow = 50 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.max_pool_size = 5 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.max_retries = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.mysql_wsrep_sync_wait = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.pool_timeout = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.retry_interval = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.slave_connection = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.sqlite_synchronous = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.synchronous_reader = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] database.use_db_reconnect = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_tracing.insecure = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.connection_string = messaging:// {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.es_doc_type = notification {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.es_scroll_size = 10000 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.es_scroll_time = 2m {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.filter_error_trace = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.hmac_keys = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.sentinel_service_name = mymaster {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:57 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.socket_timeout = 0.1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.trace_requests = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler.trace_sqlalchemy = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler_jaeger.process_tags = {} {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler_jaeger.service_name_prefix = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] profiler_otlp.service_name_prefix = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.enforce_new_defaults = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.policy_default_rule = default {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.policy_file = policy.yaml {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] privsep_osbrick.group = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] privsep_osbrick.helper_command = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] privsep_osbrick.user = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_sys_admin.group = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_sys_admin.helper_command = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] cinder_sys_admin.user = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.auth_section = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.auth_type = password {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.cafile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.collect_timing = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.insecure = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.send_service_user_token = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.split_loggers = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.timeout = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.tls_ciphers = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] service_user.tls_min_version = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.auth_section = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.auth_type = password {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.collect_timing = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.insecure = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.region_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.split_loggers = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.timeout = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.tls_ciphers = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] glance.tls_min_version = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.backend_availability_zone = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.chap_password = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.chap_username = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.disk_geometry = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.driver_client_cert = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.driver_client_cert_key = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.driver_data_namespace = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.driver_use_ssl = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.extra_capabilities = {} {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.filter_function = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.goodness_function = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86924) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.iscsi_target_flags = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.iscsi_write_cache = on {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.iser_helper = tgtadm {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.iser_ip_address = 192.168.122.83 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.iser_port = 3260 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_host = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Running cmd (subprocess): mount.quobyte {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_login = admin {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_mount_options = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_password = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_private_key = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_share_path = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.num_shell_tries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.quobyte_volume_url = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.replication_device = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.report_discard_supported = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.reserved_percentage = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.target_helper = tgtadm {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.target_ip_address = 192.168.122.83 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.target_port = 3260 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.target_protocol = iscsi {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.trace_flags = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.unique_fqdn_network = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.use_chap_auth = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_backend_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_clear = zero {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_clear_ionice = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_clear_size = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_reports.file_event_handler = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_reports.log_dir = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.backend_availability_zone = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.backend_host = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.chap_password = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.chap_username = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.chiscsi_conf = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.disk_geometry = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.driver_client_cert = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.driver_data_namespace = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.driver_use_ssl = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.extra_capabilities = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.filter_function = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.goodness_function = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.iser_helper = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.iser_ip_address = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.iser_port = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.iser_target_prefix = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_host = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_login = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_mount_options = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_password = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_private_key = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_share_path = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_ssh_port = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.num_shell_tries = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.nvmet_port_id = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.replication_device = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.report_discard_supported = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.reserved_percentage = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.scst_target_driver = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.storage_protocol = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.target_helper = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.target_ip_address = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.target_port = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.target_prefix = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.target_protocol = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.trace_flags = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.use_chap_auth = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_clear = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_clear_size = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] QuobyteHD.volumes_dir = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.ssl = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack quobyte-client[86925]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_notifications.driver = [] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_notifications.retry = -1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack quobyte-client[86925]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] key_manager.fixed_key = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.barbican_api_version = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.barbican_endpoint = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.barbican_endpoint_type = public {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.barbican_region_name = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.cafile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.collect_timing = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.insecure = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.number_of_retries = 60 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.retry_delay = 1 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.send_service_user_token = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.split_loggers = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.timeout = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.tls_ciphers = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.tls_min_version = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.verify_ssl = True {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican.verify_ssl_path = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.auth_section = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.auth_type = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.cafile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.certfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.collect_timing = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.insecure = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.keyfile = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.split_loggers = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.timeout = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.tls_ciphers = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] barbican_service_user.tls_min_version = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.approle_role_id = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.approle_secret_id = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.auth_method = approle {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.auth_path = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.kv_mountpoint = secret {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.kv_path = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.kv_version = 2 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.namespace = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.root_token_id = **** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.ssl_ca_crt_file = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.timeout = 60.0 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.token_file = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.token_role = None {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.use_ssl = False {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 16:04:58 devstack cinder-volume[86618]: DEBUG oslo_service.backend._eventlet.service [None req-02126905-a76e-4761-8f1b-db97f748529f None None] ******************************************************************************** {{(pid=86618) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 16:04:58 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:04:58 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:58 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.237s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:58 devstack cinder-volume[86924]: INFO cinder.volume.driver [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.driver [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.458740234375, 'free_capacity_gb': 1773.458740234375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86924) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_db.sqlalchemy.engines [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writer thread running {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.db.api [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Building query based on filter {{(pid=86924) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86924) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1330}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:58 devstack cinder-volume[86924]: INFO cinder.keymgr.migration [None req-f7f3b288-b9b8-4929-8e4d-008b4cf04afc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 16:04:58 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:04:58 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:58 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:04:58 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Driver initialization completed successfully. Nov 05 16:04:58 devstack cinder-volume[86924]: INFO cinder.manager [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Initiating service 3 cleanup Nov 05 16:04:58 devstack cinder-volume[86924]: INFO cinder.manager [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Service 3 cleanup completed. Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.service [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Creating RPC server for service cinder-volume {{(pid=86924) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.service [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86924) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 16:04:58 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:04:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:04:58 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:04:58 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:04:59 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Nov 05 16:04:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.233s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:04:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a1f0d652-4a35-4a57-901e-368331033840 None None] Driver post RPC initialization completed successfully. Nov 05 16:05:07 devstack cinder-volume[86618]: DEBUG dbcounter [-] [86618] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86618) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:05:08 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=3 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:05:09 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:05:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:05:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 6 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:05:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Flow 'volume_create_manager' (4f421d2e-aaa6-4117-b35e-811c7ce2aa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f3f3e3-ea22-4614-a69a-018200e740f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f3f3e3-ea22-4614-a69a-018200e740f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1164886941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6515c7-565c-4583-ab05-6f03bea95b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d3fa8859c54169b4ee10d856b80483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:05:57Z,use_quota=True,user_id='ccb233664f544c4e8b65e09b76752ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676c58fc-e6d4-40ac-9dcc-14e1aafd1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676c58fc-e6d4-40ac-9dcc-14e1aafd1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35332a1e-3ed2-40d0-b4c9-5a6f4685fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35332a1e-3ed2-40d0-b4c9-5a6f4685fab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6515c7-565c-4583-ab05-6f03bea95b31', 'volume_name': 'volume-7e6515c7-565c-4583-ab05-6f03bea95b31', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbff38c-c5c2-4993-b9a6-88f30a07e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbff38c-c5c2-4993-b9a6-88f30a07e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab64f38-ca7a-4593-946f-d48250f8c330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:57 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Volume 7e6515c7-565c-4583-ab05-6f03bea95b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6515c7-565c-4583-ab05-6f03bea95b31', 'volume_size': 1} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1164886941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6515c7-565c-4583-ab05-6f03bea95b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d3fa8859c54169b4ee10d856b80483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:05:57Z,use_quota=True,user_id='ccb233664f544c4e8b65e09b76752ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Creating volume 7e6515c7-565c-4583-ab05-6f03bea95b31 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:05:57 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:05:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:05:57 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 1073741824 Nov 05 16:05:57 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Flow 'volume_create_manager' (fc9b4cbb-031c-48a5-a775-8254ee86d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d64ef28-557c-49b7-a844-6899174f8cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d64ef28-557c-49b7-a844-6899174f8cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-883997250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a47ed37dcff49d48d9805881bab9525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:05:59Z,use_quota=True,user_id='43163cb9e7084d25a55f41a61be3a623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0b66ba-23d0-41e5-95bc-2f0dcdd94876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0b66ba-23d0-41e5-95bc-2f0dcdd94876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66814c5f-6ce4-4b97-bc8f-347eb352f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66814c5f-6ce4-4b97-bc8f-347eb352f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3', 'volume_name': 'volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f18fb1-c199-48f7-84a3-acadc2c842d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f18fb1-c199-48f7-84a3-acadc2c842d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e40c76-8813-4f1f-870b-2d2449f86564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:58 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Volume 9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3', 'volume_size': 1} Nov 05 16:05:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:05:59 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 1073741824" returned: 0 in 1.081s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:05:59 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 Nov 05 16:05:59 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:05:59 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31" returned: 0 in 0.401s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-883997250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a47ed37dcff49d48d9805881bab9525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:05:59Z,use_quota=True,user_id='43163cb9e7084d25a55f41a61be3a623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Creating volume 9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:05:59 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:05:59 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 1073741824 Nov 05 16:05:59 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab64f38-ca7a-4593-946f-d48250f8c330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6515c7-565c-4583-ab05-6f03bea95b31', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9176d4c-76ac-459a-9f5c-2c0ebfc22cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:05:59 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Volume volume-7e6515c7-565c-4583-ab05-6f03bea95b31 (7e6515c7-565c-4583-ab05-6f03bea95b31): created successfully Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9176d4c-76ac-459a-9f5c-2c0ebfc22cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:05:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Flow 'volume_create_manager' (4f421d2e-aaa6-4117-b35e-811c7ce2aa1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:05:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0fcaa070-0313-4eaa-85e2-cc4762395f6e tempest-TaggedAttachmentsTest-839790636 None] Created volume successfully. Nov 05 16:06:00 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 1073741824" returned: 0 in 0.788s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:06:00 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 Nov 05 16:06:00 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:00 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3" returned: 0 in 0.619s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:06:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:06:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e40c76-8813-4f1f-870b-2d2449f86564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3763f75d-db4b-4ff4-868b-14fdb0b81409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:06:01 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Volume volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 (9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3): created successfully Nov 05 16:06:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3763f75d-db4b-4ff4-868b-14fdb0b81409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Flow 'volume_create_manager' (fc9b4cbb-031c-48a5-a775-8254ee86d449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:06:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ad0a6439-3f8a-48eb-8bb0-5f44ad378c63 tempest-DeleteServersTestJSON-1935478870 None] Created volume successfully. Nov 05 16:06:07 devstack cinder-volume[86924]: WARNING py.warnings [req-ae3ea32e-7ea1-4a3c-af33-1b346ee70884 req-cfb2b814-89a7-4790-910a-cf0416ef5ff9 tempest-DeleteServersTestJSON-1935478870 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 05 16:06:07 devstack cinder-volume[86924]: .first() Nov 05 16:06:07 devstack cinder-volume[86924]: Nov 05 16:06:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-ae3ea32e-7ea1-4a3c-af33-1b346ee70884 req-cfb2b814-89a7-4790-910a-cf0416ef5ff9 tempest-DeleteServersTestJSON-1935478870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:06:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-ae3ea32e-7ea1-4a3c-af33-1b346ee70884 req-cfb2b814-89a7-4790-910a-cf0416ef5ff9 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:06:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-ae3ea32e-7ea1-4a3c-af33-1b346ee70884 req-cfb2b814-89a7-4790-910a-cf0416ef5ff9 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:06:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-ae3ea32e-7ea1-4a3c-af33-1b346ee70884 req-cfb2b814-89a7-4790-910a-cf0416ef5ff9 tempest-DeleteServersTestJSON-1935478870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18ca08b0-63bb-4898-ab95-1cf77f781545', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:06:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-ae3ea32e-7ea1-4a3c-af33-1b346ee70884 req-cfb2b814-89a7-4790-910a-cf0416ef5ff9 tempest-DeleteServersTestJSON-1935478870 None] attachment_update completed successfully. Nov 05 16:06:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-eb10ae0d-473f-41fa-bc13-df1760eaee3e req-ea91fbbf-0db3-420a-a6ae-f0063f6679ea tempest-DeleteServersTestJSON-1935478870 None] Terminate volume connection completed successfully. Nov 05 16:06:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-eb10ae0d-473f-41fa-bc13-df1760eaee3e req-ea91fbbf-0db3-420a-a6ae-f0063f6679ea tempest-DeleteServersTestJSON-1935478870 None] Deleting attachment 18ca08b0-63bb-4898-ab95-1cf77f781545. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:06:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Acquiring lock "cinder-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:06:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Lock "cinder-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:06:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Acquiring lock "cinder-quobyte-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:06:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Lock "cinder-quobyte-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3" acquired by "delete_volume" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:06:17 devstack cinder-volume[86924]: INFO oslo.privsep.daemon [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp74im3a7h/privsep.sock'] Nov 05 16:06:17 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp74im3a7h/privsep.sock Nov 05 16:06:17 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 16:06:18 devstack cinder-volume[86924]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 16:06:18 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:18 devstack cinder-volume[86924]: INFO oslo.privsep.daemon [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Spawned new privsep daemon via rootwrap Nov 05 16:06:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Accepted privsep connection to /tmp/tmp74im3a7h/privsep.sock {{(pid=86924) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 16:06:18 devstack cinder-volume[86924]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 16:06:18 devstack cinder-volume[86924]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 16:06:18 devstack cinder-volume[86924]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 16:06:18 devstack cinder-volume[86924]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88544 Nov 05 16:06:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b300a-21f0-4a10-94c7-4df3388dd16c]: (2,) {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:06:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a970c-2234-4d7a-956f-b8ff3b169e82]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:06:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:06:19 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 Nov 05 16:06:19 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:19 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3" returned: 0 in 0.501s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:06:19 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3 Nov 05 16:06:19 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:19 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3" returned: 0 in 0.266s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Lock "cinder-quobyte-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3" released by "delete_volume" :: held 2.654s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:06:19 devstack cinder-volume[86924]: WARNING cinder.quota [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:06:19 devstack cinder-volume[86924]: WARNING cinder.quota [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Created reservations ['943559d6-016c-4161-b9bc-63ced23129cf', '4ae8005c-d7f4-4ff9-9d27-dfa97e44eaf5', '88f948fa-bacc-4dce-ba96-067a2e9c2f29', '388e024e-39d2-4826-adc3-ca858abf3f67'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:06:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:06:19 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:06:19 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:20 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.253s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:20 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:06:20 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Deleted volume successfully. Nov 05 16:06:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcc1a63d-3c8b-4484-86be-a434a2f60860 tempest-DeleteServersTestJSON-1935478870 None] Lock "cinder-9e4d580a-fbeb-4ec5-b4eb-fe24f198ceb3-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:06:29 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:06:30 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=19,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Flow 'volume_create_manager' (569c1aaa-8186-465e-9ad9-1142ee18431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4b3be4-19d8-416e-8ab5-caf6931f41b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4b3be4-19d8-416e-8ab5-caf6931f41b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1514290999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1130a203-9601-408f-8df0-96b4be714a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f9d55526984eb294cd701621cfb28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:06:34Z,use_quota=True,user_id='cc3dc5988fb64033aa87f6a0eeae199e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebcc590-8757-455f-8419-51b39ab33d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebcc590-8757-455f-8419-51b39ab33d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece43ede-71c4-473d-80f1-a21f011cd450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece43ede-71c4-473d-80f1-a21f011cd450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1130a203-9601-408f-8df0-96b4be714a16', 'volume_name': 'volume-1130a203-9601-408f-8df0-96b4be714a16', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49e8016-1814-49f8-a9cd-8c319c9a579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49e8016-1814-49f8-a9cd-8c319c9a579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b4b0e3-486f-4390-8a28-c1590b4e2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:06:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Volume 1130a203-9601-408f-8df0-96b4be714a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1130a203-9601-408f-8df0-96b4be714a16', 'volume_size': 1} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1514290999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1130a203-9601-408f-8df0-96b4be714a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f9d55526984eb294cd701621cfb28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:06:34Z,use_quota=True,user_id='cc3dc5988fb64033aa87f6a0eeae199e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Creating volume 1130a203-9601-408f-8df0-96b4be714a16 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:06:33 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:06:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:06:33 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 1073741824 Nov 05 16:06:33 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:34 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 1073741824" returned: 0 in 0.683s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:06:34 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 Nov 05 16:06:34 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:34 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16" returned: 0 in 0.289s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:06:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:06:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b4b0e3-486f-4390-8a28-c1590b4e2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1130a203-9601-408f-8df0-96b4be714a16', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7229e6f0-ca6b-40a5-a931-29512ed994b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:06:35 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Volume volume-1130a203-9601-408f-8df0-96b4be714a16 (1130a203-9601-408f-8df0-96b4be714a16): created successfully Nov 05 16:06:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7229e6f0-ca6b-40a5-a931-29512ed994b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:06:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Flow 'volume_create_manager' (569c1aaa-8186-465e-9ad9-1142ee18431b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:06:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ed681026-800c-4913-8b0a-6135354953c9 tempest-ServerActionsTestOtherA-280250739 None] Created volume successfully. Nov 05 16:06:44 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:06:45 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:06:50 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:06:50 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:06:50 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.286s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 8 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:06:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:07:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-b8a68047-8e9e-4563-a0ca-ce9f284b5e0f req-9851bb1a-b7aa-49e4-8a48-ac636c014a2a tempest-TaggedAttachmentsTest-839790636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-b8a68047-8e9e-4563-a0ca-ce9f284b5e0f req-9851bb1a-b7aa-49e4-8a48-ac636c014a2a tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-b8a68047-8e9e-4563-a0ca-ce9f284b5e0f req-9851bb1a-b7aa-49e4-8a48-ac636c014a2a tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-b8a68047-8e9e-4563-a0ca-ce9f284b5e0f req-9851bb1a-b7aa-49e4-8a48-ac636c014a2a tempest-TaggedAttachmentsTest-839790636 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-7e6515c7-565c-4583-ab05-6f03bea95b31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3635c6a8-9e92-40ba-8672-1be882014732', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:07:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-b8a68047-8e9e-4563-a0ca-ce9f284b5e0f req-9851bb1a-b7aa-49e4-8a48-ac636c014a2a tempest-TaggedAttachmentsTest-839790636 None] attachment_update completed successfully. Nov 05 16:07:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-69f6f413-94af-42dc-bd04-a4c0b24eae77 req-01377ce0-7425-42fc-92b0-6a843f9e4db3 tempest-TaggedAttachmentsTest-839790636 None] Terminate volume connection completed successfully. Nov 05 16:07:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-69f6f413-94af-42dc-bd04-a4c0b24eae77 req-01377ce0-7425-42fc-92b0-6a843f9e4db3 tempest-TaggedAttachmentsTest-839790636 None] Deleting attachment 3635c6a8-9e92-40ba-8672-1be882014732. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:07:19 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=1,cinder:SELECT=8 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:07:19 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Flow 'volume_create_manager' (386bfb65-98e0-485d-a0db-9dc5227005dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca031706-ab17-4f5a-9307-82f29f9b53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca031706-ab17-4f5a-9307-82f29f9b53dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-404346006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9399b8-54fb-421d-933f-8520c25e1d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096b401b2cc343c49065773d714b605b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:07:26Z,use_quota=True,user_id='aeddda8de09e41ada972c61737ef3d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e2334a-c221-4616-9b9a-0fb9854c9a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e2334a-c221-4616-9b9a-0fb9854c9a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717340bb-b078-41ec-b311-46f6d4f6cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717340bb-b078-41ec-b311-46f6d4f6cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9399b8-54fb-421d-933f-8520c25e1d30', 'volume_name': 'volume-db9399b8-54fb-421d-933f-8520c25e1d30', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198a8104-de41-42cd-aab6-df32c4558a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198a8104-de41-42cd-aab6-df32c4558a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc09970-70af-4122-b6ed-a034b601acf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:26 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Volume db9399b8-54fb-421d-933f-8520c25e1d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9399b8-54fb-421d-933f-8520c25e1d30', 'volume_size': 1} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-404346006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9399b8-54fb-421d-933f-8520c25e1d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096b401b2cc343c49065773d714b605b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:07:26Z,use_quota=True,user_id='aeddda8de09e41ada972c61737ef3d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Creating volume db9399b8-54fb-421d-933f-8520c25e1d30 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:07:26 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:07:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:26 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 1073741824 Nov 05 16:07:26 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Acquiring lock "cinder-7e6515c7-565c-4583-ab05-6f03bea95b31-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:07:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Lock "cinder-7e6515c7-565c-4583-ab05-6f03bea95b31-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:07:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Acquiring lock "cinder-quobyte-7e6515c7-565c-4583-ab05-6f03bea95b31" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:07:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Lock "cinder-quobyte-7e6515c7-565c-4583-ab05-6f03bea95b31" acquired by "delete_volume" :: waited 0.037s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:07:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2792f270-a724-4712-92a7-746e1ab63c51]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:07:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:28 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 1073741824" returned: 0 in 1.330s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:28 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 Nov 05 16:07:28 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:28 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 Nov 05 16:07:28 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:28 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30" returned: 0 in 0.423s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc09970-70af-4122-b6ed-a034b601acf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9399b8-54fb-421d-933f-8520c25e1d30', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bbd164-d490-41a6-8187-d9a5dd1158ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:28 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Volume volume-db9399b8-54fb-421d-933f-8520c25e1d30 (db9399b8-54fb-421d-933f-8520c25e1d30): created successfully Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bbd164-d490-41a6-8187-d9a5dd1158ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Flow 'volume_create_manager' (386bfb65-98e0-485d-a0db-9dc5227005dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:07:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-363c74e8-596b-41f1-8fde-21474f6a8b6a tempest-ServerRescueNegativeTestJSON-1606231404 None] Created volume successfully. Nov 05 16:07:28 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31" returned: 0 in 0.949s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:28 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31 Nov 05 16:07:28 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:29 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7e6515c7-565c-4583-ab05-6f03bea95b31" returned: 0 in 0.521s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Lock "cinder-quobyte-7e6515c7-565c-4583-ab05-6f03bea95b31" released by "delete_volume" :: held 1.595s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Created reservations ['5b81caff-e2d8-4abb-9f67-6d77f6ffdb15', '10546450-47f6-4d0d-aec8-36b4f6c7fbe6', 'a6db72b2-cf20-41bb-8027-c25eb9e5a931', 'de18a263-18a9-41b6-84d5-14801c0572af'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:29 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:07:29 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-631a22dd-1423-4a5a-ba04-ba8843f9afe8 req-9d22aeac-f314-4812-8609-c1e9e0045205 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-631a22dd-1423-4a5a-ba04-ba8843f9afe8 req-9d22aeac-f314-4812-8609-c1e9e0045205 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:30 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-631a22dd-1423-4a5a-ba04-ba8843f9afe8 req-9d22aeac-f314-4812-8609-c1e9e0045205 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.558s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:30 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:07:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Deleted volume successfully. Nov 05 16:07:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-631a22dd-1423-4a5a-ba04-ba8843f9afe8 req-9d22aeac-f314-4812-8609-c1e9e0045205 tempest-ServerActionsTestOtherA-280250739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-1130a203-9601-408f-8df0-96b4be714a16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '899aba35-73a9-4268-b445-0477fe810596', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:07:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2a52913f-fe58-4a75-9b6b-970a57c69d17 tempest-TaggedAttachmentsTest-839790636 None] Lock "cinder-7e6515c7-565c-4583-ab05-6f03bea95b31-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:07:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-631a22dd-1423-4a5a-ba04-ba8843f9afe8 req-9d22aeac-f314-4812-8609-c1e9e0045205 tempest-ServerActionsTestOtherA-280250739 None] attachment_update completed successfully. Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Flow 'volume_create_manager' (eb3beb7d-4b5a-41da-894c-37f0ddf99cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b62002-4757-4ccc-963a-e637f4c85a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b62002-4757-4ccc-963a-e637f4c85a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1631499741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf12861298bd4d75943712ed136b079d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:07:37Z,use_quota=True,user_id='750d9ba8f0b1421dabaea9a85390fb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac28ea1-b6e4-4923-9f69-ab20c29d2b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac28ea1-b6e4-4923-9f69-ab20c29d2b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0ea10a-ebf9-4d00-abe7-9f1696aefefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0ea10a-ebf9-4d00-abe7-9f1696aefefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2', 'volume_name': 'volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4b18e5-9b73-40d9-a340-6e898113cb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4b18e5-9b73-40d9-a340-6e898113cb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bf0063-b2dc-4f74-b1f6-374f6c8658bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Volume 9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2', 'volume_size': 1} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1631499741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf12861298bd4d75943712ed136b079d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:07:37Z,use_quota=True,user_id='750d9ba8f0b1421dabaea9a85390fb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Creating volume 9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:07:37 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:07:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:37 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 1073741824 Nov 05 16:07:37 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:38 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 1073741824" returned: 0 in 1.090s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:38 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 Nov 05 16:07:38 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:38 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2" returned: 0 in 0.444s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:07:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bf0063-b2dc-4f74-b1f6-374f6c8658bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b803ec-392c-48cd-9d79-96bf97dbb378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:07:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Volume volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 (9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2): created successfully Nov 05 16:07:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b803ec-392c-48cd-9d79-96bf97dbb378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:07:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Flow 'volume_create_manager' (eb3beb7d-4b5a-41da-894c-37f0ddf99cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:07:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-80eb959b-a7bb-4aba-a63a-d42b60d16d3b req-9c9d2be1-7e8c-4b0c-a379-b7ababe9a776 tempest-ServerActionsTestOtherA-280250739 None] Terminate volume connection completed successfully. Nov 05 16:07:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-80eb959b-a7bb-4aba-a63a-d42b60d16d3b req-9c9d2be1-7e8c-4b0c-a379-b7ababe9a776 tempest-ServerActionsTestOtherA-280250739 None] Deleting attachment 899aba35-73a9-4268-b445-0477fe810596. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:07:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a657d25f-cf6e-48d4-9428-0a8a4cee38cf tempest-VolumesAdminNegativeTest-1260236181 None] Created volume successfully. Nov 05 16:07:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Acquiring lock "cinder-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:07:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Lock "cinder-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:07:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Acquiring lock "cinder-quobyte-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:07:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Lock "cinder-quobyte-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2" acquired by "delete_volume" :: waited 0.046s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:07:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb254c9-89f4-4f94-9471-17cdefcad5e6]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:07:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:41 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 Nov 05 16:07:41 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-80eb959b-a7bb-4aba-a63a-d42b60d16d3b req-defc4885-3f02-4612-bb2c-5dc82b924a59 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-80eb959b-a7bb-4aba-a63a-d42b60d16d3b req-defc4885-3f02-4612-bb2c-5dc82b924a59 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-80eb959b-a7bb-4aba-a63a-d42b60d16d3b req-defc4885-3f02-4612-bb2c-5dc82b924a59 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-80eb959b-a7bb-4aba-a63a-d42b60d16d3b req-defc4885-3f02-4612-bb2c-5dc82b924a59 tempest-ServerActionsTestOtherA-280250739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-1130a203-9601-408f-8df0-96b4be714a16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb5e3e7e-17cd-4210-87ea-476769d83efe', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:07:41 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2" returned: 0 in 0.760s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:41 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2 Nov 05 16:07:41 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-80eb959b-a7bb-4aba-a63a-d42b60d16d3b req-defc4885-3f02-4612-bb2c-5dc82b924a59 tempest-ServerActionsTestOtherA-280250739 None] attachment_update completed successfully. Nov 05 16:07:42 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2" returned: 0 in 0.685s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Lock "cinder-quobyte-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2" released by "delete_volume" :: held 1.592s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Created reservations ['84f06d80-d84f-44bf-a4a8-3c92eef9f45f', '1bb72270-b08f-4b7b-ba7d-f20ce101cb44', '172577b8-7e58-45d1-910e-22833f8712c5', '3ebbe6f3-ab93-4ae9-813b-3ee7ea546c19'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:42 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:07:42 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:43 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 1.021s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:43 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:07:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Deleted volume successfully. Nov 05 16:07:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56a30c66-fbf8-47c1-a03f-74ec2bdec77f tempest-VolumesAdminNegativeTest-1260236181 None] Lock "cinder-9c347fb1-1be5-4df9-a4f3-2dffecb5c8d2-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:07:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Acquiring lock "cinder-db9399b8-54fb-421d-933f-8520c25e1d30-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:07:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "cinder-db9399b8-54fb-421d-933f-8520c25e1d30-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:07:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Acquiring lock "cinder-quobyte-db9399b8-54fb-421d-933f-8520c25e1d30" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:07:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "cinder-quobyte-db9399b8-54fb-421d-933f-8520c25e1d30" acquired by "delete_volume" :: waited 0.058s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:07:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[683838ed-dfa6-40ab-9f2c-888b0830feaa]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:07:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:49 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 Nov 05 16:07:49 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:49 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30" returned: 0 in 0.562s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:49 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30 Nov 05 16:07:49 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:50 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-db9399b8-54fb-421d-933f-8520c25e1d30" returned: 0 in 0.543s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "cinder-quobyte-db9399b8-54fb-421d-933f-8520c25e1d30" released by "delete_volume" :: held 1.213s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:50 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:07:50 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Created reservations ['9c3cbf9b-bd3e-46ca-8f8a-abc4cf75d35e', 'be21a23f-fde6-4b01-9e68-05828258fd0f', '2e656023-252f-44b3-902a-cbc6a6ed03ca', '3ac6792c-7cf0-4a4c-af93-d08665ea636c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:07:50 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:07:50 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:07:50 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.366s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:07:50 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.442s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:07:50 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Deleted volume successfully. Nov 05 16:07:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a292a10-2e44-4b0e-9724-de15fc5d7a29 tempest-ServerRescueNegativeTestJSON-1606231404 None] Lock "cinder-db9399b8-54fb-421d-933f-8520c25e1d30-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:00 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=35,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:08:00 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=33,cinder:SELECT=31,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:08:01 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:08:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Flow 'volume_create_manager' (9a2aa606-6e39-4551-9d9c-cbd3580bfc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc4b631-e5ff-4179-8c49-36ab77634be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc4b631-e5ff-4179-8c49-36ab77634be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1678454310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a9aaabe8e4a97b27cd8579c8093bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:02Z,use_quota=True,user_id='0becc5aa485c45da8b7512b6b67829b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0b44e8-2ba2-474a-8927-44b06281ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0b44e8-2ba2-474a-8927-44b06281ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b200d59-924f-41e8-99a0-3155fa938411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b200d59-924f-41e8-99a0-3155fa938411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f', 'volume_name': 'volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc083731-8fc3-43ae-a0ae-cd3936801c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc083731-8fc3-43ae-a0ae-cd3936801c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b900058-8dbb-4c4d-8b5e-43676eb5e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:02 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Volume ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f', 'volume_size': 1} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1678454310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a9aaabe8e4a97b27cd8579c8093bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:02Z,use_quota=True,user_id='0becc5aa485c45da8b7512b6b67829b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Creating volume ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:08:02 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:02 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f 1073741824 Nov 05 16:08:02 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:02 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f 1073741824" returned: 0 in 0.762s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:02 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f Nov 05 16:08:02 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:03 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" returned: 0 in 0.282s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:08:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b900058-8dbb-4c4d-8b5e-43676eb5e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58892ced-6c3d-4f01-b639-22e1a4867b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:03 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Volume volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f (ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f): created successfully Nov 05 16:08:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58892ced-6c3d-4f01-b639-22e1a4867b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Flow 'volume_create_manager' (9a2aa606-6e39-4551-9d9c-cbd3580bfc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:03 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-3253964e-fbfb-4cd7-b301-7fc5bbca5bff req-f1d64f72-40f8-4b76-87bb-0eb25395bec0 tempest-VolumesSnapshotsTestJSON-202147767 None] Created volume successfully. Nov 05 16:08:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Creating offline snapshot e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 of volume ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:08:04 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df9daab-7c5f-4a81-a964-4e426803070a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:04 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f Nov 05 16:08:04 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:05 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" returned: 0 in 0.408s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:05 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 1G Nov 05 16:08:05 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:05 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 1G" returned: 0 in 0.477s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:05 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 Nov 05 16:08:05 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:06 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" returned: 0 in 0.381s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:06 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 is being set with open permissions: ugo+rw Nov 05 16:08:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:06 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 Nov 05 16:08:06 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:06 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:06 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.info Nov 05 16:08:06 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:06 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.info" returned: 0 in 0.322s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:06 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.info is being set with open permissions: ugo+rw Nov 05 16:08:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:06 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.info Nov 05 16:08:06 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:07 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.info" returned: 0 in 0.282s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-5bc4eb7c-0193-4bdf-8cd1-5d793495f395 req-518a85e5-8b98-4a34-a5a2-3c4316c29f3b tempest-VolumesSnapshotsTestJSON-202147767 None] Create snapshot completed successfully Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "cinder-e7bdbed3-14a9-4dae-87e6-8107cd34bfb5-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-e7bdbed3-14a9-4dae-87e6-8107cd34bfb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "cinder-quobyte-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-quobyte-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "cinder-quobyte-e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-quobyte-e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Deleting offline snapshot e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 of volume ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] snapshot_file for this snap is: volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8716d4bd-6b3f-4934-b417-3f786bb2dcd2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:07 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 Nov 05 16:08:07 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:07 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" returned: 0 in 0.462s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:08:08 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8840b697-7cae-4e53-b802-ae4c69ee0f93]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:08 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f Nov 05 16:08:08 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:08 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" returned: 0 in 0.420s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:08 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 Nov 05 16:08:08 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:08 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" returned: 0 in 0.401s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:08 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5 Nov 05 16:08:08 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:09 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f.e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" returned: 0 in 0.271s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-quobyte-e7bdbed3-14a9-4dae-87e6-8107cd34bfb5" released by "_delete_snapshot" :: held 1.699s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-quobyte-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" released by "delete_snapshot" :: held 1.743s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:09 devstack cinder-volume[86924]: WARNING cinder.quota [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.quota [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Created reservations ['8b0c9967-1440-4a21-b80f-7760e93dfab9', '0209b961-04a5-4a23-9266-7cb82d425f7c', 'df18c168-de85-471c-99f2-9ac8e9c3fb62', 'ea1608d4-9fec-4e6a-8d6d-f5ae0f6f19ab'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:08:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Delete snapshot completed successfully. Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-8b8540d9-4d0f-483a-bbaf-970d6ef04c66 req-442ac3d7-0a25-4fbc-bb02-8ccb56922498 tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-e7bdbed3-14a9-4dae-87e6-8107cd34bfb5-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "cinder-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "cinder-quobyte-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-quobyte-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c9aa9-40ba-43fd-bcec-b5abf0623184]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:09 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f Nov 05 16:08:09 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:10 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" returned: 0 in 0.437s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:10 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f Nov 05 16:08:10 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:10 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" returned: 0 in 0.371s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-quobyte-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f" released by "delete_volume" :: held 0.911s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG cinder.quota [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Created reservations ['1cffb4b0-0aa9-4273-ab85-b9882180be98', '2db45483-8303-4335-a4c1-85f4c4ff6028', 'e08ac514-a750-4937-8e07-0cca2c6b76d0', '7ffef7d0-40a6-4646-b9d6-24fb27176991'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:10 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:08:10 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:11 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.407s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:11 devstack cinder-volume[86924]: DEBUG cinder.manager [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:08:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Deleted volume successfully. Nov 05 16:08:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-6a122a1d-decf-443c-be2b-36d0fd56afc1 req-99a15daf-1c66-4c01-9025-cfabce1ea62a tempest-VolumesSnapshotsTestJSON-202147767 None] Lock "cinder-ccd3fa5d-4299-4d69-bd7a-a5c8a271ee8f-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-6b07db1e-ed06-4c1d-aed0-e7f8c485d947 req-1afcec77-a27b-4f52-8f89-56a255087b9d tempest-ServerActionsTestOtherA-280250739 None] Terminate volume connection completed successfully. Nov 05 16:08:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-6b07db1e-ed06-4c1d-aed0-e7f8c485d947 req-1afcec77-a27b-4f52-8f89-56a255087b9d tempest-ServerActionsTestOtherA-280250739 None] Deleting attachment eb5e3e7e-17cd-4210-87ea-476769d83efe. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:08:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e7f6e775-f6e6-48d5-9253-fae5b8cc4b84 tempest-GroupSnapshotsTest-543467503 None] Group tempest-GroupSnapshotsTest-Group-264175426: creating Nov 05 16:08:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e7f6e775-f6e6-48d5-9253-fae5b8cc4b84 tempest-GroupSnapshotsTest-543467503 None] Group tempest-GroupSnapshotsTest-Group-264175426: created successfully Nov 05 16:08:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e7f6e775-f6e6-48d5-9253-fae5b8cc4b84 tempest-GroupSnapshotsTest-543467503 None] Create group completed successfully. Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (38dcc998-0b39-455e-bfe7-887c159eccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc39b26-cb49-4a9f-8e37-b73432eb2e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc39b26-cb49-4a9f-8e37-b73432eb2e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400453453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ef15eb4-3a4e-46e2-aae2-00ea4d82ff77,host='devstack@QuobyteHD#QuobyteHD',id=5623b67e-d3c1-43fa-9d67-9d470613ef7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:20Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7bd3a47-39f9-4177-9f58-f3553cc6fad3),volume_type_id=a7bd3a47-39f9-4177-9f58-f3553cc6fad3)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa11a2c6-1a3c-4e03-a912-f8255281177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa11a2c6-1a3c-4e03-a912-f8255281177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2b2931-b0c5-4f9c-8b16-82363b91c72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2b2931-b0c5-4f9c-8b16-82363b91c72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5623b67e-d3c1-43fa-9d67-9d470613ef7c', 'volume_name': 'volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b5eaa2-f1a3-493c-af34-bdda4b6b5e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b5eaa2-f1a3-493c-af34-bdda4b6b5e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae68497-4e9a-4adb-a715-e283995acd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Volume 5623b67e-d3c1-43fa-9d67-9d470613ef7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c', 'volume_size': 1} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ef15eb4-3a4e-46e2-aae2-00ea4d82ff77,created_at=2026-11-05T15:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400453453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ef15eb4-3a4e-46e2-aae2-00ea4d82ff77,host='devstack@QuobyteHD#QuobyteHD',id=5623b67e-d3c1-43fa-9d67-9d470613ef7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:20Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7bd3a47-39f9-4177-9f58-f3553cc6fad3),volume_type_id=a7bd3a47-39f9-4177-9f58-f3553cc6fad3)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Creating volume 5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:08:19 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:08:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:20 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c 1073741824 Nov 05 16:08:20 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:20 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c 1073741824" returned: 0 in 0.517s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:20 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c Nov 05 16:08:20 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:20 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c" returned: 0 in 0.292s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae68497-4e9a-4adb-a715-e283995acd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08268271-c5f9-46da-8dcd-fabd443a44c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:20 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Volume volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c (5623b67e-d3c1-43fa-9d67-9d470613ef7c): created successfully Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08268271-c5f9-46da-8dcd-fabd443a44c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (38dcc998-0b39-455e-bfe7-887c159eccf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:20 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a36af897-8286-40b8-9d16-64bfd65fb1fb tempest-GroupSnapshotsTest-543467503 None] Created volume successfully. Nov 05 16:08:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] GroupSnapshot daeb23be-ddc9-4e4a-b3e4-d7fc9d76de1a: creating. Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Group snapshot daeb23be-ddc9-4e4a-b3e4-d7fc9d76de1a: creating. {{(pid=86924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Creating offline snapshot dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe of volume 5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef59f35a-a240-4ec1-a769-f98824cc1637]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:21 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c Nov 05 16:08:21 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:21 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c" returned: 0 in 0.420s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:21 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe 1G Nov 05 16:08:21 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:22 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe 1G" returned: 0 in 0.509s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:22 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe Nov 05 16:08:22 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:22 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" returned: 0 in 0.424s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:22 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:08:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:22 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe Nov 05 16:08:22 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:23 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:23 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.info Nov 05 16:08:23 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:23 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.info" returned: 0 in 0.345s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:23 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:08:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:23 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.info Nov 05 16:08:23 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:23 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.info" returned: 0 in 0.327s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:24 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f37a48be-fd22-4453-8fcb-f04b5888cb2f tempest-GroupSnapshotsTest-543467503 None] group_snapshot daeb23be-ddc9-4e4a-b3e4-d7fc9d76de1a: created successfully Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Creating volume 1c43c1d4-9044-4c9f-a820-64a99adf0cb6 from snapshot dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] snapshot: dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe, volume: 1c43c1d4-9044-4c9f-a820-64a99adf0cb6, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6346438c-d252-4e01-b812-872660d2793b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Flow 'volume_create_manager' (dbe38588-65a7-4a30-8653-eec92efad630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:26 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe Nov 05 16:08:26 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de18cabc-46a0-4e1c-add4-beb3e0c92bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de18cabc-46a0-4e1c-add4-beb3e0c92bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-842800466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67e96a6-7b51-40cc-b289-7e7d3481a620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f9d55526984eb294cd701621cfb28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:26Z,use_quota=True,user_id='cc3dc5988fb64033aa87f6a0eeae199e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87751ac-8074-4335-9e38-994824808e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87751ac-8074-4335-9e38-994824808e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13273c3f-c8d6-496d-be4f-18754514cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:08:26 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" returned: 0 in 0.507s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6299c18a-8b89-4fa4-8803-4d6a1e84ccf5]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:26 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c Nov 05 16:08:26 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13273c3f-c8d6-496d-be4f-18754514cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f67e96a6-7b51-40cc-b289-7e7d3481a620', 'volume_name': 'volume-f67e96a6-7b51-40cc-b289-7e7d3481a620', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c724a3-816e-42d3-8f5d-025cf1ed7b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c724a3-816e-42d3-8f5d-025cf1ed7b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c4c885-daac-42b4-b02b-1d5bea3443e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:26 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Volume f67e96a6-7b51-40cc-b289-7e7d3481a620: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f67e96a6-7b51-40cc-b289-7e7d3481a620', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 16:08:26 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Trying to clone f67e96a6-7b51-40cc-b289-7e7d3481a620 from image db5f453d-0d67-42b5-9b27-8a3136fce700 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:08:27 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c" returned: 0 in 0.523s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:27 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 Nov 05 16:08:27 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:08:27 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Image download 20.69 MB at 20.69 MB/s Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[04899c59-24d1-4841-bc8e-34002a96c05a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:27 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD Nov 05 16:08:27 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:28 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD" returned: 0 in 0.641s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:28 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 is fetched for user cc3dc5988fb64033aa87f6a0eeae199e. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:08:28 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[087691e7-462e-40dc-bf33-65bb688466a7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:28 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD Nov 05 16:08:28 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:29 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD" returned: 0 in 1.000s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:38 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=36,cinder:INSERT=7,cinder:UPDATE=26 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:08:38 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=23,cinder:SELECT=26,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:08:38 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" returned: 0 in 11.823s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:38 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c, size 1024.00 MB, duration 11.82 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:08:38 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Converted 1024.00 MB image at 86.60 MB/s Nov 05 16:08:38 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:08:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:38 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 Nov 05 16:08:38 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:39 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" returned: 0 in 0.290s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" released by "_copy_volume_from_snapshot" :: held 13.300s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" released by "_create_volume_from_snapshot" :: held 13.383s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.401s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.924s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-842800466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67e96a6-7b51-40cc-b289-7e7d3481a620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f9d55526984eb294cd701621cfb28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:26Z,use_quota=True,user_id='cc3dc5988fb64033aa87f6a0eeae199e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Creating volume f67e96a6-7b51-40cc-b289-7e7d3481a620 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:08:39 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:39 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 1073741824 Nov 05 16:08:39 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fcf6f2c4-bfd9-458f-ae38-17afebcdbfe1 tempest-GroupSnapshotsTest-543467503 None] Create group from source-snapshot-daeb23be-ddc9-4e4a-b3e4-d7fc9d76de1a completed successfully. Nov 05 16:08:39 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 1073741824" returned: 0 in 0.563s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:39 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 Nov 05 16:08:39 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:40 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620" returned: 0 in 0.429s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Attempting download of db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume f67e96a6-7b51-40cc-b289-7e7d3481a620. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb4e9c-aca8-4718-a5e7-6425f45e5397]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_y7bi3r92 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:40 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_y7bi3r92 Nov 05 16:08:40 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f247ee0a-98e9-49a7-9ca8-076ed778ddb7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:41 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_y7bi3r92" returned: 0 in 0.662s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_y7bi3r92 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:41 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 Nov 05 16:08:41 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:41 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_y7bi3r92 Nov 05 16:08:41 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:41 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_y7bi3r92" returned: 1 in 0.451s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_y7bi3r92' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec91192-0828-4ad2-9d9d-ac625f6d2c4f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:41 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD Nov 05 16:08:41 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:41 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" returned: 0 in 0.858s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:41 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6 Nov 05 16:08:41 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:42 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] db5f453d-0d67-42b5-9b27-8a3136fce700 was qcow2, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:42 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 Nov 05 16:08:42 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:42 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" returned: 0 in 0.609s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-1c43c1d4-9044-4c9f-a820-64a99adf0cb6" released by "delete_volume" :: held 1.568s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['0a405b1d-205f-46c0-b07f-20becd5c413c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:08:42 devstack cinder-volume[86924]: WARNING cinder.quota [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-413601616 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-413601616, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:08:42 devstack cinder-volume[86924]: WARNING cinder.quota [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-413601616 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-413601616, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['98ed20d3-db10-498a-9e10-18168a9a5593', '0f05dc1a-6caa-4312-9fa4-e1f64635ff28', 'c254a116-ea53-4d92-bf64-aee89abcb38f', 'ba27b91b-fb0f-4725-8172-164fdff7a500'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:43 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:08:43 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:43 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.612s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:43 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:08:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f4d1c1a5-a723-42f5-ad73-2cbe2c9f7ec1 tempest-GroupSnapshotsTest-543467503 None] Delete group completed successfully. Nov 05 16:08:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] group_snapshot daeb23be-ddc9-4e4a-b3e4-d7fc9d76de1a: deleting Nov 05 16:08:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] group_snapshot daeb23be-ddc9-4e4a-b3e4-d7fc9d76de1a: deleting {{(pid=86924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 16:08:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-5623b67e-d3c1-43fa-9d67-9d470613ef7c" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-5623b67e-d3c1-43fa-9d67-9d470613ef7c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Deleting offline snapshot dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe of volume 5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] snapshot_file for this snap is: volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1becbaa7-c8c2-4f1d-b9e6-6dfde5b2b487]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:44 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe Nov 05 16:08:44 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:44 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" returned: 0 in 0.770s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8987a2-3b15-41b1-8d07-7b5dc8de87eb]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:45 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c Nov 05 16:08:45 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:45 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620" returned: 0 in 3.145s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:45 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_1onazh9udevstack@QuobyteHD, size 112.00 MB, duration 3.15 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:08:45 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Converted 112.00 MB image at 35.53 MB/s Nov 05 16:08:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:45 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 1G Nov 05 16:08:45 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:46 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c" returned: 0 in 1.146s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:46 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 1G" returned: 0 in 0.689s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Downloaded image db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume f67e96a6-7b51-40cc-b289-7e7d3481a620 successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 for user cc3dc5988fb64033aa87f6a0eeae199e is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Marking volume f67e96a6-7b51-40cc-b289-7e7d3481a620 as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Copying metadata from image db5f453d-0d67-42b5-9b27-8a3136fce700 to f67e96a6-7b51-40cc-b289-7e7d3481a620. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Creating volume glance metadata for volume f67e96a6-7b51-40cc-b289-7e7d3481a620 backed by image db5f453d-0d67-42b5-9b27-8a3136fce700 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:08:46 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe Nov 05 16:08:46 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c4c885-daac-42b4-b02b-1d5bea3443e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67e96a6-7b51-40cc-b289-7e7d3481a620', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccf3284-3f16-44b0-804e-699883b9bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:46 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Volume volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 (f67e96a6-7b51-40cc-b289-7e7d3481a620): created successfully Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccf3284-3f16-44b0-804e-699883b9bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Flow 'volume_create_manager' (dbe38588-65a7-4a30-8653-eec92efad630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9cfb23de-41af-4157-85f0-2910c9ace28d tempest-ServerActionsTestOtherA-280250739 None] Created volume successfully. Nov 05 16:08:46 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" returned: 0 in 0.637s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:46 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe Nov 05 16:08:46 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:47 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c.dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" returned: 0 in 0.370s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-dbf10aeb-31c8-4801-86e7-c6f6ca70b1fe" released by "_delete_snapshot" :: held 3.154s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-5623b67e-d3c1-43fa-9d67-9d470613ef7c" released by "delete_snapshot" :: held 3.193s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:47 devstack cinder-volume[86924]: WARNING cinder.quota [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-413601616 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-413601616, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:08:47 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['859a4929-a969-4a5c-8883-8578053d333d', 'd64b121d-6d1e-419e-b4b8-18dc17f02fcf', '8dfc9c66-83e6-47c3-94d4-573361f9d432', '7cae66d3-a268-4df2-8dbb-0bb6552298f1'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:08:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9c308ac6-2367-4321-bb31-e7b8cc44b412 tempest-GroupSnapshotsTest-543467503 None] group_snapshot daeb23be-ddc9-4e4a-b3e4-d7fc9d76de1a: deleted successfully Nov 05 16:08:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-5623b67e-d3c1-43fa-9d67-9d470613ef7c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:08:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-5623b67e-d3c1-43fa-9d67-9d470613ef7c" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:08:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a8b068-a96e-405d-b4c8-3eae229bf6e9]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:08:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:48 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c Nov 05 16:08:48 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:49 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c" returned: 0 in 0.665s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:49 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c Nov 05 16:08:49 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:49 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5623b67e-d3c1-43fa-9d67-9d470613ef7c" returned: 0 in 0.384s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-5623b67e-d3c1-43fa-9d67-9d470613ef7c" released by "delete_volume" :: held 1.197s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:08:49 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['5b4351d8-100d-406f-896d-b9115c75adbd'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:08:49 devstack cinder-volume[86924]: WARNING cinder.db.api [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-413601616'] Nov 05 16:08:49 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['a40f5353-ec42-45db-985c-70663d3819d0', 'f2b809ae-1eb7-4912-8511-cca262bde561', '55bba961-f76b-4864-8211-db665cf46908', '8edc590a-7bb7-4cc1-af18-045e6f2a12b4'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:50 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:08:50 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:50 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:08:50 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:50 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.753s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:08:50 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7bb59dab-ecd2-4bbb-a74a-bad8f383d904 tempest-GroupSnapshotsTest-543467503 None] Delete group completed successfully. Nov 05 16:08:50 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.734s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:08:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:08:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b9bb8f74-0b03-434d-ad02-2552f15c461e tempest-GroupSnapshotsTest-543467503 None] Group tempest-GroupSnapshotsTest-Group-944163783: creating Nov 05 16:08:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b9bb8f74-0b03-434d-ad02-2552f15c461e tempest-GroupSnapshotsTest-543467503 None] Group tempest-GroupSnapshotsTest-Group-944163783: created successfully Nov 05 16:08:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b9bb8f74-0b03-434d-ad02-2552f15c461e tempest-GroupSnapshotsTest-543467503 None] Create group completed successfully. Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (46963f58-bfe2-4e6c-b3a1-c7ec755794ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87de80b-2b22-4d2e-924e-fcafcaea90c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87de80b-2b22-4d2e-924e-fcafcaea90c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860542721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8707ea4a-a058-4afd-93db-6df1909beba6,host='devstack@QuobyteHD#QuobyteHD',id=907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:54Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ec185f-b5db-4e4f-95ae-c09e224cbfb7),volume_type_id=58ec185f-b5db-4e4f-95ae-c09e224cbfb7)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d787634-dea2-4aab-afb6-20ecca4d5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d787634-dea2-4aab-afb6-20ecca4d5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1107c94-cb9f-4af9-ace8-d7f384072086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1107c94-cb9f-4af9-ace8-d7f384072086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4', 'volume_name': 'volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d7d2ea-68e9-4781-89ad-e67ab71a626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d7d2ea-68e9-4781-89ad-e67ab71a626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573329e6-7704-46f9-aecf-1855ca0bc0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:53 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Volume 907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4', 'volume_size': 1} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8707ea4a-a058-4afd-93db-6df1909beba6,created_at=2026-11-05T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860542721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8707ea4a-a058-4afd-93db-6df1909beba6,host='devstack@QuobyteHD#QuobyteHD',id=907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:54Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ec185f-b5db-4e4f-95ae-c09e224cbfb7),volume_type_id=58ec185f-b5db-4e4f-95ae-c09e224cbfb7)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Creating volume 907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:08:53 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:53 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 1073741824 Nov 05 16:08:53 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-46873087-f114-4f32-85ab-2a99075d9e32 req-fd8d89e0-1cf9-4e5b-b34d-08954eb31404 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:54 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 1073741824" returned: 0 in 0.894s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:54 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 Nov 05 16:08:54 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:55 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" returned: 0 in 0.622s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-46873087-f114-4f32-85ab-2a99075d9e32 req-fd8d89e0-1cf9-4e5b-b34d-08954eb31404 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.505s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573329e6-7704-46f9-aecf-1855ca0bc0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf386c9-529b-4620-8f3a-5a499cf7dcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-46873087-f114-4f32-85ab-2a99075d9e32 req-fd8d89e0-1cf9-4e5b-b34d-08954eb31404 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:55 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Volume volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 (907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4): created successfully Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf386c9-529b-4620-8f3a-5a499cf7dcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (46963f58-bfe2-4e6c-b3a1-c7ec755794ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-92483ca9-f170-4245-929e-b1ffe577aeb0 tempest-GroupSnapshotsTest-543467503 None] Created volume successfully. Nov 05 16:08:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-46873087-f114-4f32-85ab-2a99075d9e32 req-fd8d89e0-1cf9-4e5b-b34d-08954eb31404 tempest-ServerActionsTestOtherA-280250739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-f67e96a6-7b51-40cc-b289-7e7d3481a620', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07fbf612-f8d7-430b-8716-66211bb2fe76', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:08:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-46873087-f114-4f32-85ab-2a99075d9e32 req-fd8d89e0-1cf9-4e5b-b34d-08954eb31404 tempest-ServerActionsTestOtherA-280250739 None] attachment_update completed successfully. Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (a31a37b5-bb1d-483c-931e-2a526d32ed1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32e506c-9c7f-4059-85d4-f42c749347dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32e506c-9c7f-4059-85d4-f42c749347dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92569028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8707ea4a-a058-4afd-93db-6df1909beba6,host='devstack@QuobyteHD#QuobyteHD',id=c17c0da3-e970-4ef0-b423-bc4aa3884dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:58Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ec185f-b5db-4e4f-95ae-c09e224cbfb7),volume_type_id=58ec185f-b5db-4e4f-95ae-c09e224cbfb7)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c49d248-2ecc-4e1e-9101-1cd12802f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c49d248-2ecc-4e1e-9101-1cd12802f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c287f1df-e5c5-48dd-96b9-c04bf319bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c287f1df-e5c5-48dd-96b9-c04bf319bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c17c0da3-e970-4ef0-b423-bc4aa3884dbd', 'volume_name': 'volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6077afb9-7b38-4335-ac7d-798209ee4fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6077afb9-7b38-4335-ac7d-798209ee4fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5470ae-a930-4552-845a-5bb7a1b3d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:08:58 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Volume c17c0da3-e970-4ef0-b423-bc4aa3884dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd', 'volume_size': 1} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8707ea4a-a058-4afd-93db-6df1909beba6,created_at=2026-11-05T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92569028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8707ea4a-a058-4afd-93db-6df1909beba6,host='devstack@QuobyteHD#QuobyteHD',id=c17c0da3-e970-4ef0-b423-bc4aa3884dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:08:58Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ec185f-b5db-4e4f-95ae-c09e224cbfb7),volume_type_id=58ec185f-b5db-4e4f-95ae-c09e224cbfb7)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Creating volume c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:08:58 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:08:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:58 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd 1073741824 Nov 05 16:08:58 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:59 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd 1073741824" returned: 0 in 1.020s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:08:59 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd Nov 05 16:08:59 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:08:59 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Nov 05 16:08:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" returned: 0 in 0.530s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:08:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:08:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:08:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5470ae-a930-4552-845a-5bb7a1b3d02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:08:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47e948c-5189-4284-83c8-580716925750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:00 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Volume volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd (c17c0da3-e970-4ef0-b423-bc4aa3884dbd): created successfully Nov 05 16:09:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47e948c-5189-4284-83c8-580716925750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (a31a37b5-bb1d-483c-931e-2a526d32ed1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e6ddf344-323d-48d6-b5cb-617149c892b3 tempest-GroupSnapshotsTest-543467503 None] Created volume successfully. Nov 05 16:09:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-41bdadf1-7267-468e-ba27-6d89bea4fa15 tempest-GroupSnapshotsTest-543467503 None] Update group completed successfully. Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Flow 'volume_create_manager' (e361a6b8-41ea-4eb0-a22a-fd8c34f75e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f39429-2dd7-410a-ab9d-8a08cfcfd219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f39429-2dd7-410a-ab9d-8a08cfcfd219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1866464978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85bafd4d90944bb87846a10382dc877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:03Z,use_quota=True,user_id='0fdfd5986e6b45388434e51ce560e750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f277d2c9-4b79-452b-989e-9982cf2b2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f277d2c9-4b79-452b-989e-9982cf2b2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb570e-3570-48c1-9cea-e4c780fb031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb570e-3570-48c1-9cea-e4c780fb031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c', 'volume_name': 'volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267be55c-9ebe-4ad9-83c3-241af16c063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267be55c-9ebe-4ad9-83c3-241af16c063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe41a69e-4e2a-453d-bf79-0ceea054d0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:03 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Volume 4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c', 'volume_size': 1} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1866464978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85bafd4d90944bb87846a10382dc877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:03Z,use_quota=True,user_id='0fdfd5986e6b45388434e51ce560e750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Creating volume 4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:09:03 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:09:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:03 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c 1073741824 Nov 05 16:09:03 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:03 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8bbd19c1-f69d-480a-8303-3d2292b6aa4e tempest-GroupSnapshotsTest-543467503 None] Update group completed successfully. Nov 05 16:09:04 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c 1073741824" returned: 0 in 1.179s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:04 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-43e5ed0a-e5b8-47f4-ab1e-a7d027dbd225 tempest-GroupSnapshotsTest-543467503 None] Update group completed successfully. Nov 05 16:09:04 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c Nov 05 16:09:04 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:05 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c" returned: 0 in 0.418s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:09:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe41a69e-4e2a-453d-bf79-0ceea054d0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683832c9-c495-4a10-9093-b5bdb99fa637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:05 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Volume volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c (4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c): created successfully Nov 05 16:09:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683832c9-c495-4a10-9093-b5bdb99fa637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Flow 'volume_create_manager' (e361a6b8-41ea-4eb0-a22a-fd8c34f75e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-020d24c9-0a87-4715-8c50-893b57c37caa tempest-ServersNegativeTestJSON-300909860 None] Created volume successfully. Nov 05 16:09:06 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-722be51c-9edf-4d48-ac68-63fce5114c37 tempest-GroupSnapshotsTest-543467503 None] Update group completed successfully. Nov 05 16:09:08 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] GroupSnapshot a5dc3b64-5936-46d0-ae37-6de550c6b937: creating. Nov 05 16:09:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Group snapshot a5dc3b64-5936-46d0-ae37-6de550c6b937: creating. {{(pid=86924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 16:09:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Creating offline snapshot 0436f651-4c3a-40eb-93fa-963ec6f3295c of volume 907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:09:08 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c3bb1d-a89e-4e92-99d1-7f9e9467ba2d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:08 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 Nov 05 16:09:08 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Flow 'volume_create_manager' (4be3b91f-8b55-49a9-bd29-c63ebd30662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e17727-271e-437e-8eda-8ac866426043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:09 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e17727-271e-437e-8eda-8ac866426043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1886404861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b856f6-8544-4692-86e3-b2c65c2a1176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85bafd4d90944bb87846a10382dc877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:09Z,use_quota=True,user_id='0fdfd5986e6b45388434e51ce560e750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cfc6ae-5b28-43fc-8110-c902f26dce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cfc6ae-5b28-43fc-8110-c902f26dce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b27270-a2ca-49bc-a082-0ee977ce0d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b27270-a2ca-49bc-a082-0ee977ce0d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b856f6-8544-4692-86e3-b2c65c2a1176', 'volume_name': 'volume-43b856f6-8544-4692-86e3-b2c65c2a1176', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe05045-26a0-40b1-bbe2-8881ca4389ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe05045-26a0-40b1-bbe2-8881ca4389ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf591e62-100b-4aec-a43d-c786980db8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:09 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Volume 43b856f6-8544-4692-86e3-b2c65c2a1176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b856f6-8544-4692-86e3-b2c65c2a1176', 'volume_size': 1} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" returned: 0 in 1.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:09 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c 1G Nov 05 16:09:09 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:10 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c 1G" returned: 0 in 0.977s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:10 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c Nov 05 16:09:10 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:11 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c" returned: 0 in 0.573s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:11 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:09:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:11 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c Nov 05 16:09:11 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:11 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:11 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.info Nov 05 16:09:11 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:12 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.info" returned: 0 in 0.433s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:12 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:12 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.info Nov 05 16:09:12 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:12 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.info" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.277s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Creating offline snapshot ff033955-fab3-4999-ab8a-ff3abe6779ac of volume c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338bf80-40b4-4180-85b1-41fae821109e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:12 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd Nov 05 16:09:12 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:13 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" returned: 0 in 0.380s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:13 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac 1G Nov 05 16:09:13 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:13 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac 1G" returned: 0 in 0.470s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:13 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac Nov 05 16:09:13 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:13 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac" returned: 0 in 0.479s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:13 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:09:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:14 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac Nov 05 16:09:14 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-c3ea2ce9-919f-4c04-add2-51093421f79e req-947ebcb8-4c96-4f6d-ad4f-450790d2020f tempest-ServerActionsTestOtherA-280250739 None] Terminate volume connection completed successfully. Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-c3ea2ce9-919f-4c04-add2-51093421f79e req-947ebcb8-4c96-4f6d-ad4f-450790d2020f tempest-ServerActionsTestOtherA-280250739 None] Deleting attachment 07fbf612-f8d7-430b-8716-66211bb2fe76. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:09:14 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac" returned: 0 in 0.287s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:14 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.info Nov 05 16:09:14 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:14 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.info" returned: 0 in 0.310s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:14 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:14 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.info Nov 05 16:09:14 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:14 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.info" returned: 0 in 0.271s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.221s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1886404861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b856f6-8544-4692-86e3-b2c65c2a1176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85bafd4d90944bb87846a10382dc877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:09Z,use_quota=True,user_id='0fdfd5986e6b45388434e51ce560e750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Creating volume 43b856f6-8544-4692-86e3-b2c65c2a1176 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:09:14 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:09:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:14 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 1073741824 Nov 05 16:09:14 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b9485355-d3c3-4068-bae3-7e3cc5e20406 tempest-GroupSnapshotsTest-543467503 None] group_snapshot a5dc3b64-5936-46d0-ae37-6de550c6b937: created successfully Nov 05 16:09:15 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 1073741824" returned: 0 in 0.454s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:15 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 Nov 05 16:09:15 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-c3ea2ce9-919f-4c04-add2-51093421f79e req-dd8c2a2b-3475-4521-804f-f032db48d9a3 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:15 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176" returned: 0 in 0.258s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-c3ea2ce9-919f-4c04-add2-51093421f79e req-dd8c2a2b-3475-4521-804f-f032db48d9a3 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.019s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-c3ea2ce9-919f-4c04-add2-51093421f79e req-dd8c2a2b-3475-4521-804f-f032db48d9a3 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf591e62-100b-4aec-a43d-c786980db8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b856f6-8544-4692-86e3-b2c65c2a1176', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbfa0bb-7a52-4a8b-ae08-6dbbba04e44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Volume volume-43b856f6-8544-4692-86e3-b2c65c2a1176 (43b856f6-8544-4692-86e3-b2c65c2a1176): created successfully Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbfa0bb-7a52-4a8b-ae08-6dbbba04e44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Flow 'volume_create_manager' (4be3b91f-8b55-49a9-bd29-c63ebd30662b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-71b7f190-332d-47e1-af9b-6043d733c051 tempest-ServersNegativeTestJSON-300909860 None] Created volume successfully. Nov 05 16:09:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-c3ea2ce9-919f-4c04-add2-51093421f79e req-dd8c2a2b-3475-4521-804f-f032db48d9a3 tempest-ServerActionsTestOtherA-280250739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-f67e96a6-7b51-40cc-b289-7e7d3481a620', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '661592ce-6a9b-4d26-96b9-838f6d52dd87', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:09:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-c3ea2ce9-919f-4c04-add2-51093421f79e req-dd8c2a2b-3475-4521-804f-f032db48d9a3 tempest-ServerActionsTestOtherA-280250739 None] attachment_update completed successfully. Nov 05 16:09:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] group_snapshot a5dc3b64-5936-46d0-ae37-6de550c6b937: deleting Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] group_snapshot a5dc3b64-5936-46d0-ae37-6de550c6b937: deleting {{(pid=86924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-0436f651-4c3a-40eb-93fa-963ec6f3295c" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-0436f651-4c3a-40eb-93fa-963ec6f3295c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Deleting offline snapshot 0436f651-4c3a-40eb-93fa-963ec6f3295c of volume 907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] snapshot_file for this snap is: volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeb18ea-85be-4965-b4f8-9252ea9d1911]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:16 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c Nov 05 16:09:16 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "cinder-43b856f6-8544-4692-86e3-b2c65c2a1176-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-43b856f6-8544-4692-86e3-b2c65c2a1176-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "cinder-quobyte-43b856f6-8544-4692-86e3-b2c65c2a1176" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-quobyte-43b856f6-8544-4692-86e3-b2c65c2a1176" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37fdb68-39c3-4a8b-be46-d9c1367861d1]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:17 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 Nov 05 16:09:17 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:17 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c" returned: 0 in 0.663s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0701efd3-e747-4c9d-ba62-82a15425bf75]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:17 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 Nov 05 16:09:17 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:17 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176" returned: 0 in 0.581s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:17 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176 Nov 05 16:09:17 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:17 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" returned: 0 in 0.538s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:17 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c Nov 05 16:09:17 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:17 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43b856f6-8544-4692-86e3-b2c65c2a1176" returned: 0 in 0.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-quobyte-43b856f6-8544-4692-86e3-b2c65c2a1176" released by "delete_volume" :: held 0.901s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Created reservations ['113342c4-b10b-49ac-8181-e7a817669862', 'ca38ecaa-4bf4-4cf0-819c-a8e60964da1f', '97919d93-6c86-4994-99d7-aedb86b245e8', '3db2c762-ee95-44bf-bb74-6b71a6141386'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:17 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:09:17 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "cinder-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "cinder-quobyte-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-quobyte-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c" acquired by "delete_volume" :: waited 0.052s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3bcc7a-f9fb-4747-9e80-38a5a171cf82]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:18 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c" returned: 0 in 0.522s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:18 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c Nov 05 16:09:18 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:18 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.325s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:09:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Deleted volume successfully. Nov 05 16:09:18 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c Nov 05 16:09:18 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-211b9edc-9a07-47d6-81eb-f48157f11cb5 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-43b856f6-8544-4692-86e3-b2c65c2a1176-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:18 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4.0436f651-4c3a-40eb-93fa-963ec6f3295c" returned: 0 in 0.498s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-0436f651-4c3a-40eb-93fa-963ec6f3295c" released by "_delete_snapshot" :: held 2.381s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" released by "delete_snapshot" :: held 2.424s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:18 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c" returned: 0 in 0.670s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:18 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c Nov 05 16:09:18 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-ff033955-fab3-4999-ab8a-ff3abe6779ac" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-ff033955-fab3-4999-ab8a-ff3abe6779ac" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Deleting offline snapshot ff033955-fab3-4999-ab8a-ff3abe6779ac of volume c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] snapshot_file for this snap is: volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbf7e15-75b9-4eb8-a95b-ebbc600d52c2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:19 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac Nov 05 16:09:19 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:19 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c" returned: 0 in 0.487s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-quobyte-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c" released by "delete_volume" :: held 1.223s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Created reservations ['bd4787bf-ae21-42f2-8757-04c137ae3d20', 'cf78eda1-d783-4b5a-91b0-b3e140bced31', '4dcfe178-1076-4505-87b1-a304ebd2861c', '50f44db9-23a9-411f-8cc4-c31195675f16'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:19 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:09:19 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:19 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac" returned: 0 in 0.565s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e7197-c66d-4e78-80a4-a52ebd1b3c15]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:19 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.289s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:09:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Deleted volume successfully. Nov 05 16:09:19 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd Nov 05 16:09:19 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f67196d7-7645-4729-9171-fa234ec48158 tempest-ServersNegativeTestJSON-300909860 None] Lock "cinder-4b7adf1b-e501-4828-b8c3-a6f3b8e5f25c-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:19 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" returned: 0 in 0.443s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:20 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac Nov 05 16:09:20 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:20 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac" returned: 0 in 0.716s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:20 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac Nov 05 16:09:20 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:21 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd.ff033955-fab3-4999-ab8a-ff3abe6779ac" returned: 0 in 0.694s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-ff033955-fab3-4999-ab8a-ff3abe6779ac" released by "_delete_snapshot" :: held 2.634s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" released by "delete_snapshot" :: held 2.685s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:21 devstack cinder-volume[86924]: WARNING cinder.quota [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-407007690 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-407007690, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:09:21 devstack cinder-volume[86924]: WARNING cinder.quota [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-407007690 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-407007690, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:09:21 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Created reservations ['372a7891-4817-4f54-bd85-bd8294d8e2a1', 'ba76c0cf-fdbd-42eb-9bc9-1771f1ae617d', 'd54eb825-305b-40b8-b978-e20f583f5a88', '30d76c6c-e2ba-4f2a-9311-8f0fb7b68b7c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:21 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] Created reservations ['e347def3-6423-434f-a051-cd526cb59d55', '2a72d733-1c64-4078-bb92-038e1bdf28da', '6a6f952b-6fde-41aa-9f23-5dce5fb0d899', 'dcc6620d-f18d-46f0-af7c-805fd05d4151'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-77b73dc9-120f-40bd-86cd-d3083590683c tempest-GroupSnapshotsTest-543467503 None] group_snapshot a5dc3b64-5936-46d0-ae37-6de550c6b937: deleted successfully Nov 05 16:09:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" acquired by "delete_volume" :: waited 0.045s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:23 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb407c0-560d-4c4c-b9a9-2f9ce05f8d8c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:23 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 Nov 05 16:09:23 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:23 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" returned: 0 in 0.572s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:23 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4 Nov 05 16:09:23 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:24 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-907a6f7a-9fae-4a6e-9ce3-7079e3cc1bb4" released by "delete_volume" :: held 1.228s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[736cb334-937f-458d-b3a4-15368f901081]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:24 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd Nov 05 16:09:24 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Flow 'volume_create_manager' (8ba45cbe-66ed-47d4-8964-f48da8c99203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37a4f48-ada6-45b8-b0db-3cc1e849df01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37a4f48-ada6-45b8-b0db-3cc1e849df01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1132646606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b50ca9-7a71-4172-8397-b30afac4c7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0046e86a674f0f8c8435d084955537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:25Z,use_quota=True,user_id='6a0ae0202d6d49a996ae6e91e8e26109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db1dda0-6265-4b58-9da0-c1dd9ab65aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db1dda0-6265-4b58-9da0-c1dd9ab65aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e9627b-1e32-427b-93ac-9c4afc2b2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e9627b-1e32-427b-93ac-9c4afc2b2e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b50ca9-7a71-4172-8397-b30afac4c7d7', 'volume_name': 'volume-85b50ca9-7a71-4172-8397-b30afac4c7d7', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3788dc44-d4ed-47dc-9a3d-4521c11a1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3788dc44-d4ed-47dc-9a3d-4521c11a1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528ead14-70e3-4f0c-b6e9-b88d5b5ac016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:24 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Volume 85b50ca9-7a71-4172-8397-b30afac4c7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b50ca9-7a71-4172-8397-b30afac4c7d7', 'volume_size': 1} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1132646606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b50ca9-7a71-4172-8397-b30afac4c7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0046e86a674f0f8c8435d084955537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:25Z,use_quota=True,user_id='6a0ae0202d6d49a996ae6e91e8e26109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Creating volume 85b50ca9-7a71-4172-8397-b30afac4c7d7 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:09:24 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:09:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:24 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 1073741824 Nov 05 16:09:24 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:25 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" returned: 0 in 0.678s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:25 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd Nov 05 16:09:25 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:25 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" returned: 0 in 0.338s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-c17c0da3-e970-4ef0-b423-bc4aa3884dbd" released by "delete_volume" :: held 1.118s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:25 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 1073741824" returned: 0 in 0.607s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['ceeab314-13f9-42e7-9014-d2df38e5e71d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:25 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 Nov 05 16:09:25 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:25 devstack cinder-volume[86924]: WARNING cinder.quota [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-407007690 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-407007690, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['6f3bcbe9-4480-4e69-ba6c-94c946ba984b', '9af26b7d-3f46-4e61-8767-e1ec63fc30a5', '431db31f-c8f1-412e-823c-532d4c0bfa7a', 'e1226119-ebb5-44aa-8eed-6f69b229d083'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['a1b47feb-b31f-4788-adba-f3eb8faaf8ff', '9b555623-a415-43ff-b600-2788e602fe86', '7716fc1e-ae5a-4cbd-805c-1594d5fc7b1e', '2916d29e-dade-4de0-b1ab-6bef5596bfcb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:25 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7" returned: 0 in 0.284s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528ead14-70e3-4f0c-b6e9-b88d5b5ac016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b50ca9-7a71-4172-8397-b30afac4c7d7', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef090a7a-5b2e-40df-99b5-d09fdd2c2ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:25 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:09:25 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:25 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Volume volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 (85b50ca9-7a71-4172-8397-b30afac4c7d7): created successfully Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef090a7a-5b2e-40df-99b5-d09fdd2c2ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Flow 'volume_create_manager' (8ba45cbe-66ed-47d4-8964-f48da8c99203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-945b658f-1114-43de-83c6-ca3c064fa587 tempest-AttachVolumeShelveTestJSON-1103826897 None] Created volume successfully. Nov 05 16:09:26 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:26 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:09:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c48e6673-42b9-4ffe-8f11-5eca5a796752 tempest-GroupSnapshotsTest-543467503 None] Delete group completed successfully. Nov 05 16:09:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7fb881d1-b9ba-459e-9904-a734c7f48122 tempest-GroupSnapshotsTest-543467503 None] Group tempest-GroupSnapshotsTest-Group-1363084914: creating Nov 05 16:09:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7fb881d1-b9ba-459e-9904-a734c7f48122 tempest-GroupSnapshotsTest-543467503 None] Group tempest-GroupSnapshotsTest-Group-1363084914: created successfully Nov 05 16:09:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7fb881d1-b9ba-459e-9904-a734c7f48122 tempest-GroupSnapshotsTest-543467503 None] Create group completed successfully. Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (a528768b-a3c6-4416-9d3a-40c243e9f117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f51dba-1402-4105-868b-f17de8a5da52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f51dba-1402-4105-868b-f17de8a5da52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1142504779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35bf1a22-0cce-4b68-8432-b52bb61b9bba,host='devstack@QuobyteHD#QuobyteHD',id=d20f2183-0a47-41a7-90a2-6712190b8261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:29Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba95ce81-7d9e-4082-8438-1815599494ed),volume_type_id=ba95ce81-7d9e-4082-8438-1815599494ed)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9560e33-feb2-451a-aee4-aa10270c3387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9560e33-feb2-451a-aee4-aa10270c3387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c298488c-95a1-4bed-8710-f08e7d7ae110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c298488c-95a1-4bed-8710-f08e7d7ae110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20f2183-0a47-41a7-90a2-6712190b8261', 'volume_name': 'volume-d20f2183-0a47-41a7-90a2-6712190b8261', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a453e277-eafe-43fc-8db3-caf67f1bd040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a453e277-eafe-43fc-8db3-caf67f1bd040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bb7fa5-7eaa-4115-b39a-4bb7726b0ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:29 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Volume d20f2183-0a47-41a7-90a2-6712190b8261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20f2183-0a47-41a7-90a2-6712190b8261', 'volume_size': 1} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35bf1a22-0cce-4b68-8432-b52bb61b9bba,created_at=2026-11-05T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1142504779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35bf1a22-0cce-4b68-8432-b52bb61b9bba,host='devstack@QuobyteHD#QuobyteHD',id=d20f2183-0a47-41a7-90a2-6712190b8261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3545e18d45894530a0c2d904d48be5ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:29Z,use_quota=True,user_id='f3613543fdb146c7a5d9f5da9aee74c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba95ce81-7d9e-4082-8438-1815599494ed),volume_type_id=ba95ce81-7d9e-4082-8438-1815599494ed)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Creating volume d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:09:29 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:29 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 1073741824 Nov 05 16:09:29 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:29 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 1073741824" returned: 0 in 0.505s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:29 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 Nov 05 16:09:29 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:30 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261" returned: 0 in 0.413s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:09:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bb7fa5-7eaa-4115-b39a-4bb7726b0ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20f2183-0a47-41a7-90a2-6712190b8261', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ca65a-6104-4bec-b8b4-989efeb56954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Volume volume-d20f2183-0a47-41a7-90a2-6712190b8261 (d20f2183-0a47-41a7-90a2-6712190b8261): created successfully Nov 05 16:09:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ca65a-6104-4bec-b8b4-989efeb56954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Flow 'volume_create_manager' (a528768b-a3c6-4416-9d3a-40c243e9f117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3efcabba-d19e-4a68-bf6a-c087ad5e2133 tempest-GroupSnapshotsTest-543467503 None] Created volume successfully. Nov 05 16:09:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] GroupSnapshot f0dff7a8-90e4-492c-a1d6-a84ed794297a: creating. Nov 05 16:09:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Group snapshot f0dff7a8-90e4-492c-a1d6-a84ed794297a: creating. {{(pid=86924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 16:09:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Creating offline snapshot ca6247ba-2779-4e8f-ab2a-211255c7c4a9 of volume d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:09:32 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece4f13-c213-463d-8924-1797a100bebb]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:32 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 Nov 05 16:09:32 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:33 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261" returned: 0 in 0.605s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:33 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 1G Nov 05 16:09:33 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:33 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 1G" returned: 0 in 0.593s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d20f2183-0a47-41a7-90a2-6712190b8261 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:33 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d20f2183-0a47-41a7-90a2-6712190b8261 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 Nov 05 16:09:33 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:34 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d20f2183-0a47-41a7-90a2-6712190b8261 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9" returned: 0 in 0.480s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:34 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:09:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:34 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 Nov 05 16:09:34 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:34 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9" returned: 0 in 0.317s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:34 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.info Nov 05 16:09:34 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:34 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.info" returned: 0 in 0.351s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:34 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:09:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:34 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.info Nov 05 16:09:34 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:35 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.info" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bdc62947-5490-422e-97c6-4301ccd064e9 tempest-GroupSnapshotsTest-543467503 None] group_snapshot f0dff7a8-90e4-492c-a1d6-a84ed794297a: created successfully Nov 05 16:09:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] group_snapshot f0dff7a8-90e4-492c-a1d6-a84ed794297a: deleting Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] group_snapshot f0dff7a8-90e4-492c-a1d6-a84ed794297a: deleting {{(pid=86924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-d20f2183-0a47-41a7-90a2-6712190b8261" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-d20f2183-0a47-41a7-90a2-6712190b8261" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-ca6247ba-2779-4e8f-ab2a-211255c7c4a9" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-ca6247ba-2779-4e8f-ab2a-211255c7c4a9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Deleting offline snapshot ca6247ba-2779-4e8f-ab2a-211255c7c4a9 of volume d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] snapshot_file for this snap is: volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1983a9-c0a0-4f29-b69f-cd3f154326ef]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:36 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 Nov 05 16:09:36 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:36 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9" returned: 0 in 0.573s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d20f2183-0a47-41a7-90a2-6712190b8261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6430e1-b41d-49ae-a1e5-004e6501e5ae]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:37 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 Nov 05 16:09:37 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:37 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261" returned: 0 in 0.601s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:37 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 Nov 05 16:09:37 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:38 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9" returned: 0 in 0.513s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:38 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9 Nov 05 16:09:38 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:38 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=129,cinder:UPDATE=111,cinder:INSERT=30,cinder:DELETE=3 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261.ca6247ba-2779-4e8f-ab2a-211255c7c4a9" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=116,cinder:SELECT=117,cinder:INSERT=32,cinder:DELETE=6 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-955bc5c5-9a95-4d31-9189-112574607ab3 req-f39008ac-b53b-4fce-8e7a-e4baa62569ed tempest-AttachVolumeShelveTestJSON-1103826897 None] No connector for attachment 0bd0517d-0ebd-4e17-a9b3-2406ffbb313b; skipping storage backend terminate_connection call. {{(pid=86924) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-955bc5c5-9a95-4d31-9189-112574607ab3 req-f39008ac-b53b-4fce-8e7a-e4baa62569ed tempest-AttachVolumeShelveTestJSON-1103826897 None] Deleting attachment 0bd0517d-0ebd-4e17-a9b3-2406ffbb313b. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-ca6247ba-2779-4e8f-ab2a-211255c7c4a9" released by "_delete_snapshot" :: held 2.169s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-d20f2183-0a47-41a7-90a2-6712190b8261" released by "delete_snapshot" :: held 2.208s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:38 devstack cinder-volume[86924]: WARNING cinder.quota [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1531546658 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1531546658, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:09:38 devstack cinder-volume[86924]: WARNING cinder.quota [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1531546658 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1531546658, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:09:38 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] Created reservations ['57d05f3c-87db-4b7e-8248-926610c5c90c', 'dd19b2d3-7e9c-40bb-bfd8-fcf8e5cef56f', '648a5f65-1cfd-4e89-b8f5-9a3cad198301', '59a8b518-8c1f-48ef-94dd-be20183f62d5'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e712f2db-a85c-41e3-bc54-a42b29a7fb90 tempest-GroupSnapshotsTest-543467503 None] group_snapshot f0dff7a8-90e4-492c-a1d6-a84ed794297a: deleted successfully Nov 05 16:09:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "cinder-quobyte-d20f2183-0a47-41a7-90a2-6712190b8261" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-d20f2183-0a47-41a7-90a2-6712190b8261" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[def52d35-eb1d-408a-aa05-08555413ecbd]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:40 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 Nov 05 16:09:40 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:40 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261" returned: 0 in 0.474s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:40 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261 Nov 05 16:09:40 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:41 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d20f2183-0a47-41a7-90a2-6712190b8261" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Lock "cinder-quobyte-d20f2183-0a47-41a7-90a2-6712190b8261" released by "delete_volume" :: held 1.040s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Created reservations ['1864fc26-346a-4690-9527-255e94df31a6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:41 devstack cinder-volume[86924]: WARNING cinder.quota [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1531546658 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1531546658, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Created reservations ['393ec820-6a08-492c-8428-ee4d7eb485d1', '136ed50a-c1cb-4334-a626-a5b7387ce227', 'e03237af-4129-423e-9952-8c92a73f645e', '111fc3fe-543f-4c01-b21e-e02064ec0fb3'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:41 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:09:41 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:41 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.300s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:41 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:09:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-616fd67b-5008-4eba-b29d-4d3098d14cbd tempest-GroupSnapshotsTest-543467503 None] Delete group completed successfully. Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:50 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:09:50 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:50 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:09:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:09:51 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=19,cinder:SELECT=13,cinder:INSERT=2 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:09:51 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=14,cinder:INSERT=7,cinder:UPDATE=15 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:09:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-31d9f9c0-2de0-436a-825f-53f63efc8875 tempest-ServerActionsTestOtherA-280250739 None] Terminate volume connection completed successfully. Nov 05 16:09:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-31d9f9c0-2de0-436a-825f-53f63efc8875 tempest-ServerActionsTestOtherA-280250739 None] Deleting attachment 661592ce-6a9b-4d26-96b9-838f6d52dd87. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:09:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "cinder-f67e96a6-7b51-40cc-b289-7e7d3481a620-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-f67e96a6-7b51-40cc-b289-7e7d3481a620-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "cinder-quobyte-f67e96a6-7b51-40cc-b289-7e7d3481a620" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-quobyte-f67e96a6-7b51-40cc-b289-7e7d3481a620" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:52 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1435eba-5d91-437e-807a-466d713a621d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:52 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 Nov 05 16:09:52 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:53 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620" returned: 0 in 0.923s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:53 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620 Nov 05 16:09:53 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:54 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f67e96a6-7b51-40cc-b289-7e7d3481a620" returned: 0 in 0.782s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-quobyte-f67e96a6-7b51-40cc-b289-7e7d3481a620" released by "delete_volume" :: held 1.884s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG cinder.quota [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Created reservations ['d2976a1d-6546-4b47-9ee1-ef44252b51ed', '2b4a4364-6257-4a73-aa04-2adc109638c6', '9f8ba30e-a065-4de7-a3c8-961e15a7b388', '8918dd67-74e4-4963-8028-c5296c577e49'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:54 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:09:54 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:54 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.381s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG cinder.manager [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:09:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Deleted volume successfully. Nov 05 16:09:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-ff3a7ad6-86c5-441a-98da-7c311b990e86 req-dabe847a-d08b-43f3-968a-5b6dbdf6d941 tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-f67e96a6-7b51-40cc-b289-7e7d3481a620-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fda32980-4c65-4cde-90f0-2dbb753721c7 tempest-GroupSnapshotsV319Test-68162237 None] Group tempest-GroupSnapshotsV319Test-Group-672843714: creating Nov 05 16:09:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fda32980-4c65-4cde-90f0-2dbb753721c7 tempest-GroupSnapshotsV319Test-68162237 None] Group tempest-GroupSnapshotsV319Test-Group-672843714: created successfully Nov 05 16:09:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fda32980-4c65-4cde-90f0-2dbb753721c7 tempest-GroupSnapshotsV319Test-68162237 None] Create group completed successfully. Nov 05 16:09:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "cinder-1130a203-9601-408f-8df0-96b4be714a16-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-1130a203-9601-408f-8df0-96b4be714a16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "cinder-quobyte-1130a203-9601-408f-8df0-96b4be714a16" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:09:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-quobyte-1130a203-9601-408f-8df0-96b4be714a16" acquired by "delete_volume" :: waited 0.039s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:09:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[155cd499-4cf5-4f3b-832f-157c7b039a89]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:09:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:56 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 Nov 05 16:09:56 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:56 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16" returned: 0 in 0.872s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:56 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16 Nov 05 16:09:56 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:57 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1130a203-9601-408f-8df0-96b4be714a16" returned: 0 in 0.521s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-quobyte-1130a203-9601-408f-8df0-96b4be714a16" released by "delete_volume" :: held 1.467s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Created reservations ['4589bc1f-e57d-43fb-afe0-b1a6920f4314', 'e6762b8f-9421-4d47-8114-fa86f10b2c2d', 'bf5bed8a-000c-4dda-ae7a-e1dfaff1a676', '4c33ab37-418e-46d2-8efb-39d944f8dfb0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:57 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:09:57 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:58 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.373s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:09:58 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Deleted volume successfully. Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5b1394b7-cd55-4dd5-995d-974f175c03ac tempest-ServerActionsTestOtherA-280250739 None] Lock "cinder-1130a203-9601-408f-8df0-96b4be714a16-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Flow 'volume_create_manager' (5f1974d6-47f1-41dc-9405-73deb1afb39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56805b37-9c4f-4041-afcf-45c570e49c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56805b37-9c4f-4041-afcf-45c570e49c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680103467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2ad5dbf-8dba-4daf-a0db-19c61b7674e0,host='devstack@QuobyteHD#QuobyteHD',id=625518bf-84bf-46ba-a938-8c01144ba617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef622a5c1f544b9b4373a04b708373e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:58Z,use_quota=True,user_id='b98e56ba29684bc7b699744829fba1d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8a3c13-2993-4a84-9e5f-1dcf3f86db7d),volume_type_id=2a8a3c13-2993-4a84-9e5f-1dcf3f86db7d)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9914d3b-5d50-4457-befb-3a7a76785e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9914d3b-5d50-4457-befb-3a7a76785e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3853ba68-c47b-45d5-87c6-0324d39cba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3853ba68-c47b-45d5-87c6-0324d39cba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625518bf-84bf-46ba-a938-8c01144ba617', 'volume_name': 'volume-625518bf-84bf-46ba-a938-8c01144ba617', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f1196a-5619-4721-bb22-665fc683e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f1196a-5619-4721-bb22-665fc683e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f011b3f-1808-429c-b41e-b384614ec745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:58 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Volume 625518bf-84bf-46ba-a938-8c01144ba617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625518bf-84bf-46ba-a938-8c01144ba617', 'volume_size': 1} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a2ad5dbf-8dba-4daf-a0db-19c61b7674e0,created_at=2026-11-05T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680103467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2ad5dbf-8dba-4daf-a0db-19c61b7674e0,host='devstack@QuobyteHD#QuobyteHD',id=625518bf-84bf-46ba-a938-8c01144ba617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef622a5c1f544b9b4373a04b708373e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:09:58Z,use_quota=True,user_id='b98e56ba29684bc7b699744829fba1d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8a3c13-2993-4a84-9e5f-1dcf3f86db7d),volume_type_id=2a8a3c13-2993-4a84-9e5f-1dcf3f86db7d)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Creating volume 625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:09:58 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:09:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:58 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 1073741824 Nov 05 16:09:58 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:59 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 1073741824" returned: 0 in 0.824s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:09:59 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 Nov 05 16:09:59 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:09:59 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617" returned: 0 in 0.534s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f011b3f-1808-429c-b41e-b384614ec745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625518bf-84bf-46ba-a938-8c01144ba617', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea00eb9a-07da-4241-b1d0-d498f405f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:09:59 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Volume volume-625518bf-84bf-46ba-a938-8c01144ba617 (625518bf-84bf-46ba-a938-8c01144ba617): created successfully Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea00eb9a-07da-4241-b1d0-d498f405f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:09:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Flow 'volume_create_manager' (5f1974d6-47f1-41dc-9405-73deb1afb39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:09:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f502d24d-a760-474e-96b3-43d1944b519f tempest-GroupSnapshotsV319Test-68162237 None] Created volume successfully. Nov 05 16:10:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] GroupSnapshot 470f072d-c894-413c-beac-dc2d0e9b4675: creating. Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Group snapshot 470f072d-c894-413c-beac-dc2d0e9b4675: creating. {{(pid=86924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Creating offline snapshot 40a0a68e-7c14-4c06-944b-ec4d58125a9b of volume 625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c98219f-99e3-49aa-a484-be4c9e6196b3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:01 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 Nov 05 16:10:01 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:01 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617" returned: 0 in 0.812s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:01 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b 1G Nov 05 16:10:01 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:02 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b 1G" returned: 0 in 1.022s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625518bf-84bf-46ba-a938-8c01144ba617 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:03 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625518bf-84bf-46ba-a938-8c01144ba617 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b Nov 05 16:10:03 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:03 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-625518bf-84bf-46ba-a938-8c01144ba617 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b" returned: 0 in 0.601s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:03 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:10:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:03 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b Nov 05 16:10:03 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:04 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b" returned: 0 in 0.452s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:04 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.info Nov 05 16:10:04 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:04 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.info" returned: 0 in 0.468s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:04 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:10:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:04 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.info Nov 05 16:10:04 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:04 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.info" returned: 0 in 0.349s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.854s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1d018301-7ee7-4843-9fc8-4910b3fb2ae5 tempest-GroupSnapshotsV319Test-68162237 None] group_snapshot 470f072d-c894-413c-beac-dc2d0e9b4675: created successfully Nov 05 16:10:06 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] group_snapshot 470f072d-c894-413c-beac-dc2d0e9b4675: deleting Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] group_snapshot 470f072d-c894-413c-beac-dc2d0e9b4675: deleting {{(pid=86924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Acquiring lock "cinder-quobyte-625518bf-84bf-46ba-a938-8c01144ba617" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Lock "cinder-quobyte-625518bf-84bf-46ba-a938-8c01144ba617" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Acquiring lock "cinder-quobyte-40a0a68e-7c14-4c06-944b-ec4d58125a9b" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Lock "cinder-quobyte-40a0a68e-7c14-4c06-944b-ec4d58125a9b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Deleting offline snapshot 40a0a68e-7c14-4c06-944b-ec4d58125a9b of volume 625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] snapshot_file for this snap is: volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cacbfd7-7bb5-452d-ac8f-f9108c8c8102]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:06 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b Nov 05 16:10:06 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:07 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b" returned: 0 in 0.761s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-625518bf-84bf-46ba-a938-8c01144ba617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:10:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea23f66-988b-4b8c-a3f4-863e0b81c2ba]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:07 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 Nov 05 16:10:07 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:08 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617" returned: 0 in 0.680s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:08 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b Nov 05 16:10:08 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:08 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b" returned: 0 in 0.511s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:08 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b Nov 05 16:10:08 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:09 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617.40a0a68e-7c14-4c06-944b-ec4d58125a9b" returned: 0 in 0.354s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Lock "cinder-quobyte-40a0a68e-7c14-4c06-944b-ec4d58125a9b" released by "_delete_snapshot" :: held 2.524s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Lock "cinder-quobyte-625518bf-84bf-46ba-a938-8c01144ba617" released by "delete_snapshot" :: held 2.558s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:09 devstack cinder-volume[86924]: WARNING cinder.quota [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-729932121 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-729932121, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:10:09 devstack cinder-volume[86924]: WARNING cinder.quota [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-729932121 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-729932121, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:10:09 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] Created reservations ['7bd5e56b-13b1-4d47-9e22-311ceb5d7a61', 'aac0e860-7c5e-48f5-98be-91e6f9959ee7', 'f6f76b69-70fd-4a01-9a81-c60d569f26db', '5224eae9-73fe-466d-8f49-15318ab28002'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-68c3c275-fbec-43ed-9dd2-d75f2e4131cf tempest-GroupSnapshotsV319Test-68162237 None] group_snapshot 470f072d-c894-413c-beac-dc2d0e9b4675: deleted successfully Nov 05 16:10:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Acquiring lock "cinder-quobyte-625518bf-84bf-46ba-a938-8c01144ba617" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Lock "cinder-quobyte-625518bf-84bf-46ba-a938-8c01144ba617" acquired by "delete_volume" :: waited 0.038s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1274983-af92-4dff-9b0f-0d28e154bf9b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:10 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 Nov 05 16:10:10 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:10 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617" returned: 0 in 0.384s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:10 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617 Nov 05 16:10:10 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:11 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-625518bf-84bf-46ba-a938-8c01144ba617" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Lock "cinder-quobyte-625518bf-84bf-46ba-a938-8c01144ba617" released by "delete_volume" :: held 0.782s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Created reservations ['785868dc-5718-46c0-8ed1-922f869a9e6d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:11 devstack cinder-volume[86924]: WARNING cinder.quota [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-729932121 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-729932121, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Created reservations ['42e49d14-668a-4910-be54-bd3a1ff91494', '9bc22ecd-3c61-426f-a456-f889b2956900', 'addc9381-5937-4600-8fd1-1d5edb61d64d', 'b1ebc3e4-d7b7-49f3-8352-7c8c8e7fb1b2'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:11 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:10:11 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:11 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.318s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:11 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:10:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-09b6ea42-3ba2-4ff7-9605-6ca3e6118878 tempest-GroupSnapshotsV319Test-68162237 None] Delete group completed successfully. Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Flow 'volume_create_manager' (97ced761-9dcc-4d3a-9188-a856fa426200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8894ed-f472-48d2-aa0e-102238b71f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8894ed-f472-48d2-aa0e-102238b71f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-519660267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2946bf92-9dc0-4f9e-87c8-b8e199c72291,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b467db31dfe48f080339af9c55fcc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:15Z,use_quota=True,user_id='099c479c4b174e938674f8b66e035a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccf0824-b0bf-4d7c-963f-ae37059824ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccf0824-b0bf-4d7c-963f-ae37059824ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1401de-4cf9-4c7e-976c-ebcd71cd9dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1401de-4cf9-4c7e-976c-ebcd71cd9dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2946bf92-9dc0-4f9e-87c8-b8e199c72291', 'volume_name': 'volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0578f980-c717-4beb-ab7c-32cfb984790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:15 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 1073741824 Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0578f980-c717-4beb-ab7c-32cfb984790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6554db95-0fe3-4e42-8b10-faf21278fe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Volume 2946bf92-9dc0-4f9e-87c8-b8e199c72291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291', 'volume_size': 1} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:15 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-519660267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2946bf92-9dc0-4f9e-87c8-b8e199c72291,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b467db31dfe48f080339af9c55fcc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:15Z,use_quota=True,user_id='099c479c4b174e938674f8b66e035a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Creating volume 2946bf92-9dc0-4f9e-87c8-b8e199c72291 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:10:15 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:10:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:16 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 1073741824" returned: 0 in 0.641s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:16 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 Nov 05 16:10:16 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:16 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291" returned: 0 in 0.436s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6554db95-0fe3-4e42-8b10-faf21278fe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10415d7c-6c3a-4785-af2b-b613e0050443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Volume volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 (2946bf92-9dc0-4f9e-87c8-b8e199c72291): created successfully Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10415d7c-6c3a-4785-af2b-b613e0050443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Flow 'volume_create_manager' (97ced761-9dcc-4d3a-9188-a856fa426200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-caac0b46-4858-4fe0-af35-5347fce9a74a req-60a2d9fc-0973-4236-9f08-3c4dedcb2ecd tempest-VolumesGetTestJSON-1488147479 None] Created volume successfully. Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Acquiring lock "cinder-2946bf92-9dc0-4f9e-87c8-b8e199c72291-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Lock "cinder-2946bf92-9dc0-4f9e-87c8-b8e199c72291-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Acquiring lock "cinder-quobyte-2946bf92-9dc0-4f9e-87c8-b8e199c72291" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Lock "cinder-quobyte-2946bf92-9dc0-4f9e-87c8-b8e199c72291" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b1f182-2355-4d17-8db2-e099b2635374]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:18 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 Nov 05 16:10:18 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:18 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291" returned: 0 in 0.425s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:18 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291 Nov 05 16:10:18 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:19 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-2946bf92-9dc0-4f9e-87c8-b8e199c72291" returned: 0 in 0.308s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Lock "cinder-quobyte-2946bf92-9dc0-4f9e-87c8-b8e199c72291" released by "delete_volume" :: held 0.795s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG cinder.quota [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Created reservations ['3847c64f-5052-494a-868f-ab60983cf5f2', 'e3f7a492-8c91-4cd9-a784-d70db165a385', 'c3d14ed6-afb4-4550-bfe1-40d645469273', 'a92bbdb8-aa65-4721-a7f2-dc5eb7ab03ae'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:19 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:10:19 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:19 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.412s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG cinder.manager [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:10:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Deleted volume successfully. Nov 05 16:10:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-7bd33a52-d530-408e-a433-404113791717 req-63e4394d-5510-4da5-8a6c-821b2c708586 tempest-VolumesGetTestJSON-1488147479 None] Lock "cinder-2946bf92-9dc0-4f9e-87c8-b8e199c72291-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Acquiring lock "cinder-85b50ca9-7a71-4172-8397-b30afac4c7d7-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "cinder-85b50ca9-7a71-4172-8397-b30afac4c7d7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Acquiring lock "cinder-quobyte-85b50ca9-7a71-4172-8397-b30afac4c7d7" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "cinder-quobyte-85b50ca9-7a71-4172-8397-b30afac4c7d7" acquired by "delete_volume" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:21 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2395526b-20e4-439a-b19f-dd5e5427ccd0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:21 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 Nov 05 16:10:21 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:22 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7" returned: 0 in 0.379s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:22 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7 Nov 05 16:10:22 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:22 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85b50ca9-7a71-4172-8397-b30afac4c7d7" returned: 0 in 0.344s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "cinder-quobyte-85b50ca9-7a71-4172-8397-b30afac4c7d7" released by "delete_volume" :: held 0.784s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Created reservations ['13cd23f1-6518-426e-871e-400c81e95c57', 'fe026180-aa2f-4496-a222-498f946ee322', 'd875332e-c808-4340-894a-d476e9dd1110', '4acb95ab-c534-4724-90c6-018dde7e89fe'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:22 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:10:22 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:23 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.345s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:23 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:10:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Deleted volume successfully. Nov 05 16:10:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f2935170-f972-47ca-8e05-33023b2e17e3 tempest-AttachVolumeShelveTestJSON-1103826897 None] Lock "cinder-85b50ca9-7a71-4172-8397-b30afac4c7d7-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d9ed5569-b026-4673-985f-621584609a66 tempest-GroupsTest-1659642759 None] Group tempest-Group1-1236275025: creating Nov 05 16:10:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d9ed5569-b026-4673-985f-621584609a66 tempest-GroupsTest-1659642759 None] Group tempest-Group1-1236275025: created successfully Nov 05 16:10:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d9ed5569-b026-4673-985f-621584609a66 tempest-GroupsTest-1659642759 None] Create group completed successfully. Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Flow 'volume_create_manager' (1f140bb7-22be-4b77-912f-8e71b20bd9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b33031-2ea4-443f-9784-fa6b4febafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b33031-2ea4-443f-9784-fa6b4febafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-71923160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16285b16-8c4b-4289-8ee6-6dfa02f39ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b845b95d97c4004b59ee288a1d3d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:29Z,use_quota=True,user_id='2717a640a1af48ad8ceceb2b48802254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9426750-8191-462b-a0d3-8e49cc8d8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9426750-8191-462b-a0d3-8e49cc8d8fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e4754d-d180-48b9-8684-24fce1409bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e4754d-d180-48b9-8684-24fce1409bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16285b16-8c4b-4289-8ee6-6dfa02f39ed4', 'volume_name': 'volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeee175-53b0-4c4e-9c81-f2c21a2c23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eeee175-53b0-4c4e-9c81-f2c21a2c23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4339040-f72c-41c9-ad88-97f6e4fe5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:29 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Volume 16285b16-8c4b-4289-8ee6-6dfa02f39ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4', 'volume_size': 1} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-71923160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16285b16-8c4b-4289-8ee6-6dfa02f39ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b845b95d97c4004b59ee288a1d3d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:29Z,use_quota=True,user_id='2717a640a1af48ad8ceceb2b48802254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Creating volume 16285b16-8c4b-4289-8ee6-6dfa02f39ed4 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:10:29 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:29 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 1073741824 Nov 05 16:10:29 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-74e4b7c3-8a5c-491f-ab44-6c7a5b295bae tempest-GroupsTest-1659642759 None] Group tempest-Group2-452174104: creating Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 1073741824" returned: 0 in 0.600s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:29 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-74e4b7c3-8a5c-491f-ab44-6c7a5b295bae tempest-GroupsTest-1659642759 None] Group tempest-Group2-452174104: created successfully Nov 05 16:10:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-74e4b7c3-8a5c-491f-ab44-6c7a5b295bae tempest-GroupsTest-1659642759 None] Create group completed successfully. Nov 05 16:10:29 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 Nov 05 16:10:29 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfc98a48-e86a-42ae-b3a8-83aa0c1c6d7e tempest-BackendsCapabilitiesAdminTestsJSON-2006974346 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.458740234375, 'free_capacity_gb': 1773.458740234375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86924) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1a7d5faa-8511-40fe-94ae-cd0d4734ae20 tempest-BackendsCapabilitiesAdminTestsJSON-2006974346 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.458740234375, 'free_capacity_gb': 1773.458740234375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86924) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 16:10:30 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4" returned: 0 in 0.325s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4339040-f72c-41c9-ad88-97f6e4fe5700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4888ef08-936d-4e1d-9a7c-7818a49bdde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Volume volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 (16285b16-8c4b-4289-8ee6-6dfa02f39ed4): created successfully Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4888ef08-936d-4e1d-9a7c-7818a49bdde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Flow 'volume_create_manager' (1f140bb7-22be-4b77-912f-8e71b20bd9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b574b694-2b45-4f97-bef8-2392b9e7badd tempest-AttachVolumeTestJSON-2058676164 None] Created volume successfully. Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Flow 'volume_create_manager' (e22d6dd5-c529-456e-a2aa-6d25a64c8b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8e4079-05b5-43ed-a130-52b29b17a6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8e4079-05b5-43ed-a130-52b29b17a6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067132908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4558448a-9ee6-45f7-9b13-2c25e5908750,host='devstack@QuobyteHD#QuobyteHD',id=069018ef-65e5-41d6-bd77-5f9b0a29f52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127d48bcd72a4c34a7b3730d100f2967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:32Z,use_quota=True,user_id='c1acd868c68a4144b40acab9fba0432a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4689348-6410-4dd9-b8d0-f20e25936573),volume_type_id=e4689348-6410-4dd9-b8d0-f20e25936573)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf7921-eab7-4989-a9aa-93ea3fcfb7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf7921-eab7-4989-a9aa-93ea3fcfb7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0740e891-5276-4a33-a92d-33886b51ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0740e891-5276-4a33-a92d-33886b51ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069018ef-65e5-41d6-bd77-5f9b0a29f52f', 'volume_name': 'volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48eb67b-8db5-44e2-852e-546d21aa5a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48eb67b-8db5-44e2-852e-546d21aa5a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b98c34d-77ff-4d47-92f5-7dbc38b62a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:32 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Volume 069018ef-65e5-41d6-bd77-5f9b0a29f52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f', 'volume_size': 1} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4558448a-9ee6-45f7-9b13-2c25e5908750,created_at=2026-11-05T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067132908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4558448a-9ee6-45f7-9b13-2c25e5908750,host='devstack@QuobyteHD#QuobyteHD',id=069018ef-65e5-41d6-bd77-5f9b0a29f52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127d48bcd72a4c34a7b3730d100f2967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:32Z,use_quota=True,user_id='c1acd868c68a4144b40acab9fba0432a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4689348-6410-4dd9-b8d0-f20e25936573),volume_type_id=e4689348-6410-4dd9-b8d0-f20e25936573)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Creating volume 069018ef-65e5-41d6-bd77-5f9b0a29f52f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:10:32 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:32 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f 1073741824 Nov 05 16:10:32 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:32 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f 1073741824" returned: 0 in 0.752s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f9ed0956-1b55-4f57-84d1-34a8f1978dce req-4169e46e-9daa-40b4-8606-dc3b1098cbbe tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:32 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f Nov 05 16:10:32 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:33 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f" returned: 0 in 0.305s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f9ed0956-1b55-4f57-84d1-34a8f1978dce req-4169e46e-9daa-40b4-8606-dc3b1098cbbe tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.344s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b98c34d-77ff-4d47-92f5-7dbc38b62a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa3f5f-690b-400c-b64f-743df36ddece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f9ed0956-1b55-4f57-84d1-34a8f1978dce req-4169e46e-9daa-40b4-8606-dc3b1098cbbe tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Volume volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f (069018ef-65e5-41d6-bd77-5f9b0a29f52f): created successfully Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa3f5f-690b-400c-b64f-743df36ddece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Flow 'volume_create_manager' (e22d6dd5-c529-456e-a2aa-6d25a64c8b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-eddb3726-850e-4735-bc08-838587d9486a tempest-GroupsTest-1659642759 None] Created volume successfully. Nov 05 16:10:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-f9ed0956-1b55-4f57-84d1-34a8f1978dce req-4169e46e-9daa-40b4-8606-dc3b1098cbbe tempest-AttachVolumeTestJSON-2058676164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6824a947-e3c6-446e-a0a1-305184a18aad', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:10:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-f9ed0956-1b55-4f57-84d1-34a8f1978dce req-4169e46e-9daa-40b4-8606-dc3b1098cbbe tempest-AttachVolumeTestJSON-2058676164 None] attachment_update completed successfully. Nov 05 16:10:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Acquiring lock "cinder-quobyte-069018ef-65e5-41d6-bd77-5f9b0a29f52f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Lock "cinder-quobyte-069018ef-65e5-41d6-bd77-5f9b0a29f52f" acquired by "delete_volume" :: waited 0.039s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:35 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf45bc-d3f1-4a2a-a3b3-261ff4ec8022]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:35 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f Nov 05 16:10:35 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:35 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f" returned: 0 in 0.410s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:35 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f Nov 05 16:10:35 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:36 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-069018ef-65e5-41d6-bd77-5f9b0a29f52f" returned: 0 in 0.272s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Lock "cinder-quobyte-069018ef-65e5-41d6-bd77-5f9b0a29f52f" released by "delete_volume" :: held 0.740s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Created reservations ['9c377549-5403-4d02-83ac-f8abe18c173d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:36 devstack cinder-volume[86924]: WARNING cinder.quota [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-475260863 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-475260863, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:10:36 devstack cinder-volume[86924]: WARNING cinder.quota [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-475260863 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-475260863, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Created reservations ['402595aa-9c26-42b1-ae92-fda1c749487f', 'c433fadb-404f-4267-a00d-cb76a492ecb0', '725942f3-1699-4eae-a2e1-71155c552bd8', 'bd6e5fbe-f853-49e8-b6f8-8d15e3ef6367'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:36 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:10:36 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:36 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.373s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:10:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c6b6ded2-4f9f-46ab-afcd-789cb4bf1027 tempest-GroupsTest-1659642759 None] Delete group completed successfully. Nov 05 16:10:36 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Created reservations ['d0799621-3095-4ac0-97a3-055b4686a567'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:37 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:10:37 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:37 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:37 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:10:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bdac2383-9d4c-4b87-9072-8a26d6c63ad4 tempest-GroupsTest-1659642759 None] Delete group completed successfully. Nov 05 16:10:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d002c07d-c5b2-45dc-9971-29d3dcf2fdfa tempest-GroupsTest-1659642759 None] Group tempest-GroupsTest-Group-157188366: creating Nov 05 16:10:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d002c07d-c5b2-45dc-9971-29d3dcf2fdfa tempest-GroupsTest-1659642759 None] Group tempest-GroupsTest-Group-157188366: created successfully Nov 05 16:10:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d002c07d-c5b2-45dc-9971-29d3dcf2fdfa tempest-GroupsTest-1659642759 None] Create group completed successfully. Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Flow 'volume_create_manager' (8ff45f4a-8a83-4cd1-9e48-88ba2d7d6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda3a227-9cc4-4899-b460-b7dd83505c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda3a227-9cc4-4899-b460-b7dd83505c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146533713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62b6eff4-a93c-4a3e-96fc-387844c856e1,host='devstack@QuobyteHD#QuobyteHD',id=393fa7fe-abb0-42b0-bbc4-6113020b7a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127d48bcd72a4c34a7b3730d100f2967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:42Z,use_quota=True,user_id='c1acd868c68a4144b40acab9fba0432a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73722da4-64d3-403b-9335-3096aeae777d),volume_type_id=73722da4-64d3-403b-9335-3096aeae777d)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7040060d-e2f3-4109-a6ab-712adb76326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7040060d-e2f3-4109-a6ab-712adb76326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb69d03-95f7-44c5-9086-cf5149670565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb69d03-95f7-44c5-9086-cf5149670565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393fa7fe-abb0-42b0-bbc4-6113020b7a8d', 'volume_name': 'volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb57179-8046-4dd7-ba51-887797a9fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb57179-8046-4dd7-ba51-887797a9fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6767f8-d4f2-4c64-b81e-745140988a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:41 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Volume 393fa7fe-abb0-42b0-bbc4-6113020b7a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d', 'volume_size': 1} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62b6eff4-a93c-4a3e-96fc-387844c856e1,created_at=2026-11-05T15:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146533713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62b6eff4-a93c-4a3e-96fc-387844c856e1,host='devstack@QuobyteHD#QuobyteHD',id=393fa7fe-abb0-42b0-bbc4-6113020b7a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127d48bcd72a4c34a7b3730d100f2967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:42Z,use_quota=True,user_id='c1acd868c68a4144b40acab9fba0432a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73722da4-64d3-403b-9335-3096aeae777d),volume_type_id=73722da4-64d3-403b-9335-3096aeae777d)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Creating volume 393fa7fe-abb0-42b0-bbc4-6113020b7a8d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:10:41 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:10:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:41 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d 1073741824 Nov 05 16:10:41 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:42 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d 1073741824" returned: 0 in 1.012s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:42 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d Nov 05 16:10:42 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:43 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d" returned: 0 in 0.443s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:10:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6767f8-d4f2-4c64-b81e-745140988a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3337adb2-ba07-4f7d-bddc-d4cdd789aff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Volume volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d (393fa7fe-abb0-42b0-bbc4-6113020b7a8d): created successfully Nov 05 16:10:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3337adb2-ba07-4f7d-bddc-d4cdd789aff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Flow 'volume_create_manager' (8ff45f4a-8a83-4cd1-9e48-88ba2d7d6546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4add09b2-1492-4e97-b94b-13fa5df1db54 tempest-GroupsTest-1659642759 None] Created volume successfully. Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Flow 'volume_create_manager' (5aa57ccc-ba96-4ce5-b140-ef550335a483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a17e204-51c0-4007-b28e-483e31c6f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a17e204-51c0-4007-b28e-483e31c6f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556059480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62b6eff4-a93c-4a3e-96fc-387844c856e1,host='devstack@QuobyteHD#QuobyteHD',id=fc88b60a-2303-440d-aab4-e82a26d6cfa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127d48bcd72a4c34a7b3730d100f2967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:46Z,use_quota=True,user_id='c1acd868c68a4144b40acab9fba0432a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73722da4-64d3-403b-9335-3096aeae777d),volume_type_id=73722da4-64d3-403b-9335-3096aeae777d)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b030205a-3ff6-4766-bda5-5896a014d16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b030205a-3ff6-4766-bda5-5896a014d16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da85e905-df09-47a6-8962-ebf3464fb509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da85e905-df09-47a6-8962-ebf3464fb509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc88b60a-2303-440d-aab4-e82a26d6cfa7', 'volume_name': 'volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0154977d-c05a-44f4-9598-6b341510c7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0154977d-c05a-44f4-9598-6b341510c7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010e444c-5af7-4a7b-b908-d4066849ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:45 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Volume fc88b60a-2303-440d-aab4-e82a26d6cfa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7', 'volume_size': 1} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62b6eff4-a93c-4a3e-96fc-387844c856e1,created_at=2026-11-05T15:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-556059480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62b6eff4-a93c-4a3e-96fc-387844c856e1,host='devstack@QuobyteHD#QuobyteHD',id=fc88b60a-2303-440d-aab4-e82a26d6cfa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='127d48bcd72a4c34a7b3730d100f2967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:46Z,use_quota=True,user_id='c1acd868c68a4144b40acab9fba0432a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73722da4-64d3-403b-9335-3096aeae777d),volume_type_id=73722da4-64d3-403b-9335-3096aeae777d)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Creating volume fc88b60a-2303-440d-aab4-e82a26d6cfa7 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:10:45 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:10:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:45 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 1073741824 Nov 05 16:10:45 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:46 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 1073741824" returned: 0 in 0.660s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:46 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 Nov 05 16:10:46 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:47 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7" returned: 0 in 0.461s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:10:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010e444c-5af7-4a7b-b908-d4066849ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdc7305-1a8a-4ee8-aa58-d15617db4a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:47 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Volume volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 (fc88b60a-2303-440d-aab4-e82a26d6cfa7): created successfully Nov 05 16:10:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdc7305-1a8a-4ee8-aa58-d15617db4a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Flow 'volume_create_manager' (5aa57ccc-ba96-4ce5-b140-ef550335a483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bfb739b0-02d3-4b1e-b398-b34d58a727ce tempest-GroupsTest-1659642759 None] Created volume successfully. Nov 05 16:10:48 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-035548b7-9f3c-4635-9ef6-ee251786621d tempest-GroupsTest-1659642759 None] Update group completed successfully. Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:50 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9dd5ddc2-b21c-4d29-a29d-133ff82c6fa6 tempest-GroupsTest-1659642759 None] Update group completed successfully. Nov 05 16:10:50 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:10:50 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:50 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.331s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:10:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=79,cinder:UPDATE=99,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=91,cinder:INSERT=20,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Acquiring lock "cinder-quobyte-393fa7fe-abb0-42b0-bbc4-6113020b7a8d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Lock "cinder-quobyte-393fa7fe-abb0-42b0-bbc4-6113020b7a8d" acquired by "delete_volume" :: waited 0.054s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db47aed-6af8-49fc-bf04-33ecc8b8d049]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:52 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d Nov 05 16:10:52 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:52 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d" returned: 0 in 0.555s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:52 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d Nov 05 16:10:52 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:53 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-393fa7fe-abb0-42b0-bbc4-6113020b7a8d" returned: 0 in 0.312s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Lock "cinder-quobyte-393fa7fe-abb0-42b0-bbc4-6113020b7a8d" released by "delete_volume" :: held 0.939s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Acquiring lock "cinder-quobyte-fc88b60a-2303-440d-aab4-e82a26d6cfa7" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:10:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Lock "cinder-quobyte-fc88b60a-2303-440d-aab4-e82a26d6cfa7" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:10:53 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea62bfff-268f-4b0d-b97c-b7eb4ac5f25c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:53 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 Nov 05 16:10:53 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:54 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7" returned: 0 in 0.841s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:54 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7 Nov 05 16:10:54 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:54 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Flow 'volume_create_manager' (84f19922-f49b-4aec-ad21-1fde56b3393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882f8509-0dfd-4a9b-aa95-7d3e4b141abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc88b60a-2303-440d-aab4-e82a26d6cfa7" returned: 0 in 0.573s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882f8509-0dfd-4a9b-aa95-7d3e4b141abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-324067604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3161cd4-d465-4134-bf3c-ee5da901f441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ef3b557c174b9ea8f9e41edd9079ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:54Z,use_quota=True,user_id='ceeba33fb3884d1089433c8b1ca9ebb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a516c1e-f062-4feb-be82-f95503a9684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a516c1e-f062-4feb-be82-f95503a9684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee2c55c-aedb-418a-ac52-0fb0acc87f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee2c55c-aedb-418a-ac52-0fb0acc87f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3161cd4-d465-4134-bf3c-ee5da901f441', 'volume_name': 'volume-f3161cd4-d465-4134-bf3c-ee5da901f441', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0dbf3-17f4-4994-99e4-546023bc4341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0dbf3-17f4-4994-99e4-546023bc4341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77fee3a-bbab-4a26-bd98-a5242cfb0c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Volume f3161cd4-d465-4134-bf3c-ee5da901f441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3161cd4-d465-4134-bf3c-ee5da901f441', 'volume_size': 1} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-324067604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3161cd4-d465-4134-bf3c-ee5da901f441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ef3b557c174b9ea8f9e41edd9079ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:10:54Z,use_quota=True,user_id='ceeba33fb3884d1089433c8b1ca9ebb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Creating volume f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:10:54 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Lock "cinder-quobyte-fc88b60a-2303-440d-aab4-e82a26d6cfa7" released by "delete_volume" :: held 1.573s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:10:54 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 1073741824 Nov 05 16:10:54 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Created reservations ['4996dcb4-7bec-480a-bbbe-294829ab5a7f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:54 devstack cinder-volume[86924]: WARNING cinder.quota [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1587916502 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1587916502, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:10:54 devstack cinder-volume[86924]: WARNING cinder.quota [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1587916502 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1587916502, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:10:54 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Created reservations ['652a14ad-3821-453c-bf9b-7a274112978c', '29073d92-59b3-48c2-a1cc-9795ddba29e6', '44d65908-686c-4784-b7ad-f451281709a8', 'f77cbc47-b2f4-41bf-98bd-512c8be818b1'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Created reservations ['fdde2bfb-2ec8-4228-83a2-cd99741913e6', 'babcbe24-2f71-48c4-9f4b-02841855b99c', '7b0996e5-3b41-4bd1-a000-19c92e240fd3', '690bb3ce-d718-4715-b153-c79005d13185'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:55 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:10:55 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:55 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 1073741824" returned: 0 in 1.033s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:55 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 Nov 05 16:10:55 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:55 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:55 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:10:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-53bc35e9-bef1-4f75-888a-f3c932bec0c0 tempest-GroupsTest-1659642759 None] Delete group completed successfully. Nov 05 16:10:56 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441" returned: 0 in 0.306s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77fee3a-bbab-4a26-bd98-a5242cfb0c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3161cd4-d465-4134-bf3c-ee5da901f441', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4da00f4-d20f-4728-b078-2ea50dafb205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:10:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Volume volume-f3161cd4-d465-4134-bf3c-ee5da901f441 (f3161cd4-d465-4134-bf3c-ee5da901f441): created successfully Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4da00f4-d20f-4728-b078-2ea50dafb205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Flow 'volume_create_manager' (84f19922-f49b-4aec-ad21-1fde56b3393e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:10:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4cb62af8-ca95-478f-87d6-739918287800 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Created volume successfully. Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:10:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Creating offline snapshot 01fc36bb-885c-4ca2-bcfe-d62891697988 of volume f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:10:57 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1371c92d-6fe3-4efe-94b9-c27e540982e6]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:10:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:57 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 Nov 05 16:10:57 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:57 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441" returned: 0 in 0.403s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:57 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 1G Nov 05 16:10:57 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 1G" returned: 0 in 0.467s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3161cd4-d465-4134-bf3c-ee5da901f441 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:57 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:57 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3161cd4-d465-4134-bf3c-ee5da901f441 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 Nov 05 16:10:57 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:58 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3161cd4-d465-4134-bf3c-ee5da901f441 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988" returned: 0 in 0.458s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:58 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 is being set with open permissions: ugo+rw Nov 05 16:10:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:58 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 Nov 05 16:10:58 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:58 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988" returned: 0 in 0.479s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:58 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.info Nov 05 16:10:58 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:59 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.info" returned: 0 in 0.639s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:10:59 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.info is being set with open permissions: ugo+rw Nov 05 16:10:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:10:59 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.info Nov 05 16:10:59 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:10:59 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Nov 05 16:10:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.info" returned: 0 in 0.394s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.032s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ed45f5af-3874-4d52-88aa-1ebf090214ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Create snapshot completed successfully Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "cinder-01fc36bb-885c-4ca2-bcfe-d62891697988-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-01fc36bb-885c-4ca2-bcfe-d62891697988-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "cinder-quobyte-f3161cd4-d465-4134-bf3c-ee5da901f441" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-quobyte-f3161cd4-d465-4134-bf3c-ee5da901f441" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "cinder-quobyte-01fc36bb-885c-4ca2-bcfe-d62891697988" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-quobyte-01fc36bb-885c-4ca2-bcfe-d62891697988" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Deleting offline snapshot 01fc36bb-885c-4ca2-bcfe-d62891697988 of volume f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] snapshot_file for this snap is: volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[131de208-7411-4bc7-a53e-b18f3303f943]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:01 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 Nov 05 16:11:01 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:01 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3161cd4-d465-4134-bf3c-ee5da901f441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:11:01 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ecc3fa-91a9-4ecc-b259-d0de665ffa7d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:01 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 Nov 05 16:11:01 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:01 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441" returned: 0 in 0.478s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:01 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 Nov 05 16:11:01 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:02 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988" returned: 0 in 0.531s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:02 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988 Nov 05 16:11:02 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:03 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441.01fc36bb-885c-4ca2-bcfe-d62891697988" returned: 0 in 0.516s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-quobyte-01fc36bb-885c-4ca2-bcfe-d62891697988" released by "_delete_snapshot" :: held 2.205s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-quobyte-f3161cd4-d465-4134-bf3c-ee5da901f441" released by "delete_snapshot" :: held 2.237s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:03 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Created reservations ['d922627f-e647-4244-84d6-514483e6e798', '5a22741b-760e-44f6-8743-ee6ae492214b', '29bf1e11-70d1-435e-aaf9-ccb1c412774d', '31e615da-829a-4c67-8c79-b917b4881d8f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:03 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Delete snapshot completed successfully. Nov 05 16:11:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f68d893e-7c68-4424-aaea-57efdb9c0aa7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-01fc36bb-885c-4ca2-bcfe-d62891697988-delete_snapshot" released by "delete_snapshot" :: held 2.470s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "cinder-f3161cd4-d465-4134-bf3c-ee5da901f441-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-f3161cd4-d465-4134-bf3c-ee5da901f441-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "cinder-quobyte-f3161cd4-d465-4134-bf3c-ee5da901f441" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-quobyte-f3161cd4-d465-4134-bf3c-ee5da901f441" acquired by "delete_volume" :: waited 0.030s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb1fe9-fe45-4cef-8db3-a99b89168822]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:04 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 Nov 05 16:11:04 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441" returned: 0 in 0.417s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:04 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:05 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441 Nov 05 16:11:05 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:05 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f3161cd4-d465-4134-bf3c-ee5da901f441" returned: 0 in 0.354s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-quobyte-f3161cd4-d465-4134-bf3c-ee5da901f441" released by "delete_volume" :: held 0.901s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Created reservations ['e8723fe7-7c16-4585-819a-07d2492d7a48', 'e4536af1-52dd-454a-a868-b3d1bf1c516c', '2bad883a-c77a-4477-9d49-967843005c4d', 'd3f734a3-6f9a-4c13-9895-5e6b9ba7eae4'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:05 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:05 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-c0676566-487a-4b53-aa57-226f869529ee req-b03e6723-d173-4e23-8cc1-6a5a897435d1 tempest-AttachVolumeTestJSON-2058676164 None] Terminate volume connection completed successfully. Nov 05 16:11:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-c0676566-487a-4b53-aa57-226f869529ee req-b03e6723-d173-4e23-8cc1-6a5a897435d1 tempest-AttachVolumeTestJSON-2058676164 None] Deleting attachment 6824a947-e3c6-446e-a0a1-305184a18aad. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:11:06 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.459s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:06 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:06 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Deleted volume successfully. Nov 05 16:11:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dd909a33-25c8-4c90-b84c-d4c0a55bf1a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1422169366 None] Lock "cinder-f3161cd4-d465-4134-bf3c-ee5da901f441-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:15 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=36,cinder:SELECT=35,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=24,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Flow 'volume_create_manager' (9f68fcb9-9e17-40f5-9be1-7dbdf61bd84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076d37a1-74a1-4031-832f-dd2c658620d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076d37a1-74a1-4031-832f-dd2c658620d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-19506826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b143d2ac-1b32-4106-a90c-94c17c33de35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b1b1cb61c84ce2a49b87cccb9ae0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:17Z,use_quota=True,user_id='1149717ace66456e8c47c969bffb2e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b248beac-ffe3-4497-b829-e7b019324a01),volume_type_id=b248beac-ffe3-4497-b829-e7b019324a01)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9c621a-e6a5-44a4-912a-e01282eaa25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9c621a-e6a5-44a4-912a-e01282eaa25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4bb619-9b97-4aae-87bc-72f76123bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4bb619-9b97-4aae-87bc-72f76123bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b143d2ac-1b32-4106-a90c-94c17c33de35', 'volume_name': 'volume-b143d2ac-1b32-4106-a90c-94c17c33de35', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff8049b-81ca-4ecb-85fe-f224d1856fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff8049b-81ca-4ecb-85fe-f224d1856fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c60ea60-07c1-43e4-b0f8-3fbb16fb9142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Volume b143d2ac-1b32-4106-a90c-94c17c33de35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b143d2ac-1b32-4106-a90c-94c17c33de35', 'volume_size': 1} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-19506826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b143d2ac-1b32-4106-a90c-94c17c33de35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b1b1cb61c84ce2a49b87cccb9ae0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:17Z,use_quota=True,user_id='1149717ace66456e8c47c969bffb2e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b248beac-ffe3-4497-b829-e7b019324a01),volume_type_id=b248beac-ffe3-4497-b829-e7b019324a01)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Creating volume b143d2ac-1b32-4106-a90c-94c17c33de35 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:16 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:16 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 1073741824 Nov 05 16:11:16 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:17 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 1073741824" returned: 0 in 0.537s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:17 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 Nov 05 16:11:17 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:17 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35" returned: 0 in 0.275s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c60ea60-07c1-43e4-b0f8-3fbb16fb9142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b143d2ac-1b32-4106-a90c-94c17c33de35', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8616de-8b06-4144-a1c2-8908b8d35d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Volume volume-b143d2ac-1b32-4106-a90c-94c17c33de35 (b143d2ac-1b32-4106-a90c-94c17c33de35): created successfully Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8616de-8b06-4144-a1c2-8908b8d35d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Flow 'volume_create_manager' (9f68fcb9-9e17-40f5-9be1-7dbdf61bd84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8cacec26-10a3-4952-a6e7-1450c0c4a0a8 tempest-VolumeTypesAccessTest-1143729771 None] Created volume successfully. Nov 05 16:11:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Acquiring lock "cinder-b143d2ac-1b32-4106-a90c-94c17c33de35-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Lock "cinder-b143d2ac-1b32-4106-a90c-94c17c33de35-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Acquiring lock "cinder-quobyte-b143d2ac-1b32-4106-a90c-94c17c33de35" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Lock "cinder-quobyte-b143d2ac-1b32-4106-a90c-94c17c33de35" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5f50d-5a3a-422b-86c9-987606370c2f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:18 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 Nov 05 16:11:18 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:19 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35" returned: 0 in 0.379s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:19 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35 Nov 05 16:11:19 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:19 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b143d2ac-1b32-4106-a90c-94c17c33de35" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Lock "cinder-quobyte-b143d2ac-1b32-4106-a90c-94c17c33de35" released by "delete_volume" :: held 0.676s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:19 devstack cinder-volume[86924]: WARNING cinder.quota [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-856995948 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-856995948, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:11:19 devstack cinder-volume[86924]: WARNING cinder.quota [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-856995948 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-856995948, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Created reservations ['0bbbe103-b53d-4245-be24-f63d5a24e737', 'fe238364-3231-481d-ad0c-07646410758d', '822cc226-a8dd-4f82-b51e-5d6254122815', 'ef6533d4-3858-4343-b730-05718398fa1f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:19 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:19 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:19 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.312s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:19 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Deleted volume successfully. Nov 05 16:11:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4e4dd66d-d262-47b6-8296-6e149ca13143 tempest-VolumeTypesAccessTest-1143729771 None] Lock "cinder-b143d2ac-1b32-4106-a90c-94c17c33de35-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Flow 'volume_create_manager' (62fde874-1804-4bf0-90aa-51cc3a36ccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16112764-903d-4db5-9f3e-5994a96f6160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16112764-903d-4db5-9f3e-5994a96f6160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1775238740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249bc79c-4960-4b3d-b092-7320faa85cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c05a2210c554e7c895e7df0832c975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:24Z,use_quota=True,user_id='a9a86bb9702d40aa8adc8557eca814f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c1964d-270c-4bd8-8657-9c408b737e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c1964d-270c-4bd8-8657-9c408b737e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2079d82e-845a-4be6-8e9d-7e732d8c7175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2079d82e-845a-4be6-8e9d-7e732d8c7175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249bc79c-4960-4b3d-b092-7320faa85cc5', 'volume_name': 'volume-249bc79c-4960-4b3d-b092-7320faa85cc5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b945bb-7cc5-4217-be06-c1ae55353e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b945bb-7cc5-4217-be06-c1ae55353e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9fb753-b3f9-4ea7-a0f3-27b13f466313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:24 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Volume 249bc79c-4960-4b3d-b092-7320faa85cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249bc79c-4960-4b3d-b092-7320faa85cc5', 'volume_size': 1} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1775238740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249bc79c-4960-4b3d-b092-7320faa85cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c05a2210c554e7c895e7df0832c975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:24Z,use_quota=True,user_id='a9a86bb9702d40aa8adc8557eca814f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Creating volume 249bc79c-4960-4b3d-b092-7320faa85cc5 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:24 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:24 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 1073741824 Nov 05 16:11:24 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:25 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 1073741824" returned: 0 in 0.622s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:25 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 Nov 05 16:11:25 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:25 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5" returned: 0 in 0.406s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9fb753-b3f9-4ea7-a0f3-27b13f466313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249bc79c-4960-4b3d-b092-7320faa85cc5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c34f876-4b01-4066-98ea-1210da3b8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:25 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Volume volume-249bc79c-4960-4b3d-b092-7320faa85cc5 (249bc79c-4960-4b3d-b092-7320faa85cc5): created successfully Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c34f876-4b01-4066-98ea-1210da3b8cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Flow 'volume_create_manager' (62fde874-1804-4bf0-90aa-51cc3a36ccac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-91cc96be-bce5-4261-9a47-816961f5f1a1 tempest-AttachVolumeNegativeTest-129395497 None] Created volume successfully. Nov 05 16:11:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-479a6c92-9b74-4f62-93c1-555cbf6c52b0 req-c67c7ee2-816b-4653-9b2f-4c008a21c068 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-479a6c92-9b74-4f62-93c1-555cbf6c52b0 req-c67c7ee2-816b-4653-9b2f-4c008a21c068 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-479a6c92-9b74-4f62-93c1-555cbf6c52b0 req-c67c7ee2-816b-4653-9b2f-4c008a21c068 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-479a6c92-9b74-4f62-93c1-555cbf6c52b0 req-c67c7ee2-816b-4653-9b2f-4c008a21c068 tempest-AttachVolumeNegativeTest-129395497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-249bc79c-4960-4b3d-b092-7320faa85cc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3dc4308-f687-4f21-8d6c-563c3a05e776', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:11:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-479a6c92-9b74-4f62-93c1-555cbf6c52b0 req-c67c7ee2-816b-4653-9b2f-4c008a21c068 tempest-AttachVolumeNegativeTest-129395497 None] attachment_update completed successfully. Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Flow 'volume_create_manager' (6fb5b5dd-cfe2-45e7-a4ad-1806aa1adb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10787dde-c88d-489f-9824-32e3cf13f6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10787dde-c88d-489f-9824-32e3cf13f6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1372393123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ee5b68-6c42-4cae-8a46-39ff1d1ff390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fc2b8f4afe4b818d235d2915ab56df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:30Z,use_quota=True,user_id='2182c0dd8bc04f288d382c7123e36dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60f490a-679e-456c-aa58-87cb3e67fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60f490a-679e-456c-aa58-87cb3e67fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f9f94e-7c69-41e8-8d7e-01a0de1c79d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Flow 'volume_create_manager' (45f1c07f-6076-403e-86f9-07da89fc0798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93baa124-d76f-4003-9c2e-f4fc122a29d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93baa124-d76f-4003-9c2e-f4fc122a29d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1316247156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e285e919-b568-4d95-8e87-8fa3b7766b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4989ba4150dc446883b74d3e4f05e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:30Z,use_quota=True,user_id='5d74dc26054542f7882ff4566dde9e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119d0137-443f-42c0-bec3-85fe2db6cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119d0137-443f-42c0-bec3-85fe2db6cd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67566038-473e-4824-9357-82b058e0cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67566038-473e-4824-9357-82b058e0cd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e285e919-b568-4d95-8e87-8fa3b7766b17', 'volume_name': 'volume-e285e919-b568-4d95-8e87-8fa3b7766b17', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f377b4-be39-4442-9273-dd54ee557e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f377b4-be39-4442-9273-dd54ee557e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd2ce5a-8a52-4bea-8867-41f87c819b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Volume e285e919-b568-4d95-8e87-8fa3b7766b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e285e919-b568-4d95-8e87-8fa3b7766b17', 'volume_size': 1} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1316247156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e285e919-b568-4d95-8e87-8fa3b7766b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4989ba4150dc446883b74d3e4f05e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:30Z,use_quota=True,user_id='5d74dc26054542f7882ff4566dde9e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Creating volume e285e919-b568-4d95-8e87-8fa3b7766b17 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:30 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:30 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 1073741824 Nov 05 16:11:30 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f9f94e-7c69-41e8-8d7e-01a0de1c79d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91ee5b68-6c42-4cae-8a46-39ff1d1ff390', 'volume_name': 'volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91786298-6095-4839-9e85-cbf5165c3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91786298-6095-4839-9e85-cbf5165c3915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef98a6c-a686-484e-bbbe-2132c6ca7de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Volume 91ee5b68-6c42-4cae-8a46-39ff1d1ff390: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Trying to clone 91ee5b68-6c42-4cae-8a46-39ff1d1ff390 from image db5f453d-0d67-42b5-9b27-8a3136fce700 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:11:30 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 1073741824" returned: 0 in 0.553s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:11:31 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Image download 20.69 MB at 20.69 MB/s Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dc770e-bff4-4a1d-97d1-e43ee14475ca]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:31 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 Nov 05 16:11:31 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:31 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD Nov 05 16:11:31 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:31 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17" returned: 0 in 0.284s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd2ce5a-8a52-4bea-8867-41f87c819b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e285e919-b568-4d95-8e87-8fa3b7766b17', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aeace33-29f5-410e-b356-717524dc0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Volume volume-e285e919-b568-4d95-8e87-8fa3b7766b17 (e285e919-b568-4d95-8e87-8fa3b7766b17): created successfully Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aeace33-29f5-410e-b356-717524dc0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Flow 'volume_create_manager' (45f1c07f-6076-403e-86f9-07da89fc0798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:31 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-df0e7023-e8c8-4237-9624-0c6a92186c68 tempest-VolumesListAdminTestJSON-2133451101 None] Created volume successfully. Nov 05 16:11:31 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 is fetched for user 2182c0dd8bc04f288d382c7123e36dd6. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c9ee2-09dd-406e-9889-9da2defd8d02]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:31 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD Nov 05 16:11:31 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:31 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1372393123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ee5b68-6c42-4cae-8a46-39ff1d1ff390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fc2b8f4afe4b818d235d2915ab56df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:30Z,use_quota=True,user_id='2182c0dd8bc04f288d382c7123e36dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Creating volume 91ee5b68-6c42-4cae-8a46-39ff1d1ff390 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:31 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:32 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 1073741824 Nov 05 16:11:32 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:32 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 1073741824" returned: 0 in 0.630s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:32 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 Nov 05 16:11:32 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:33 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Flow 'volume_create_manager' (b990a156-85d4-475b-938e-a8863f350979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2666e0e-51ee-4454-906a-a12c30bae36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2666e0e-51ee-4454-906a-a12c30bae36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1918333210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdfb4f9-b524-4ebb-937d-8fe882462616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4989ba4150dc446883b74d3e4f05e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:33Z,use_quota=True,user_id='5d74dc26054542f7882ff4566dde9e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f9b66a-0750-45af-9721-b0ec95d422ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f9b66a-0750-45af-9721-b0ec95d422ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdd7811-eb3d-4e37-814c-7d41b7132140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdd7811-eb3d-4e37-814c-7d41b7132140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbdfb4f9-b524-4ebb-937d-8fe882462616', 'volume_name': 'volume-bbdfb4f9-b524-4ebb-937d-8fe882462616', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cede3d46-d52d-441a-b66c-436172063661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cede3d46-d52d-441a-b66c-436172063661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c729e7af-c5dd-4de3-89c7-1dc424939b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Volume bbdfb4f9-b524-4ebb-937d-8fe882462616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbdfb4f9-b524-4ebb-937d-8fe882462616', 'volume_size': 1} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1918333210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdfb4f9-b524-4ebb-937d-8fe882462616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4989ba4150dc446883b74d3e4f05e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:33Z,use_quota=True,user_id='5d74dc26054542f7882ff4566dde9e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Creating volume bbdfb4f9-b524-4ebb-937d-8fe882462616 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:33 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:33 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 1073741824 Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Attempting download of db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume 91ee5b68-6c42-4cae-8a46-39ff1d1ff390. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:11:33 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e13ba-2ec8-4056-ace2-c3f513f9f8f9]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_qqzbh7j7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:33 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_qqzbh7j7 Nov 05 16:11:33 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:33 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_qqzbh7j7" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_qqzbh7j7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:33 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 1073741824" returned: 0 in 0.503s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:33 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 Nov 05 16:11:33 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:33 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_qqzbh7j7 Nov 05 16:11:33 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:33 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616" returned: 0 in 0.285s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c729e7af-c5dd-4de3-89c7-1dc424939b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdfb4f9-b524-4ebb-937d-8fe882462616', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0847539-355a-4c74-a1f1-43955b34bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:34 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Volume volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 (bbdfb4f9-b524-4ebb-937d-8fe882462616): created successfully Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0847539-355a-4c74-a1f1-43955b34bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:34 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Flow 'volume_create_manager' (b990a156-85d4-475b-938e-a8863f350979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_qqzbh7j7" returned: 1 in 0.403s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_qqzbh7j7' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c7bf63-7e73-4e33-a771-3ac86356027b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:34 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-72c42022-1c30-4caf-8eb6-7d244bad759d tempest-VolumesListAdminTestJSON-2133451101 None] Created volume successfully. Nov 05 16:11:34 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD Nov 05 16:11:34 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:34 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] db5f453d-0d67-42b5-9b27-8a3136fce700 was qcow2, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:11:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:34 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 Nov 05 16:11:34 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Flow 'volume_create_manager' (4e0760ec-3717-4f87-9149-84bd625b8543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ec7ffb-7000-4ab6-938a-64afb4b73b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ec7ffb-7000-4ab6-938a-64afb4b73b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1780360344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb372cb0-937d-4dc1-8169-92debacb6a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4989ba4150dc446883b74d3e4f05e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:36Z,use_quota=True,user_id='5d74dc26054542f7882ff4566dde9e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b76b361-0300-40b0-85c7-7827fef6b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b76b361-0300-40b0-85c7-7827fef6b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a1a481-fe22-4a27-90b9-590ab719b593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a1a481-fe22-4a27-90b9-590ab719b593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb372cb0-937d-4dc1-8169-92debacb6a68', 'volume_name': 'volume-fb372cb0-937d-4dc1-8169-92debacb6a68', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059efdd5-ec90-4120-820b-1dc29416559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059efdd5-ec90-4120-820b-1dc29416559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a76d18-819d-40a5-b30a-fb3e231deff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:36 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Volume fb372cb0-937d-4dc1-8169-92debacb6a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb372cb0-937d-4dc1-8169-92debacb6a68', 'volume_size': 1} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1780360344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb372cb0-937d-4dc1-8169-92debacb6a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4989ba4150dc446883b74d3e4f05e5e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:36Z,use_quota=True,user_id='5d74dc26054542f7882ff4566dde9e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Creating volume fb372cb0-937d-4dc1-8169-92debacb6a68 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:36 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:36 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 1073741824 Nov 05 16:11:36 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:36 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 1073741824" returned: 0 in 0.653s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:37 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 Nov 05 16:11:37 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:37 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390" returned: 0 in 2.819s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pn_qpzaudevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:11:37 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Converted 112.00 MB image at 39.69 MB/s Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:37 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 1G Nov 05 16:11:37 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:37 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a76d18-819d-40a5-b30a-fb3e231deff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb372cb0-937d-4dc1-8169-92debacb6a68', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f6e180-6b70-478e-b75f-7d2e06a2f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Volume volume-fb372cb0-937d-4dc1-8169-92debacb6a68 (fb372cb0-937d-4dc1-8169-92debacb6a68): created successfully Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f6e180-6b70-478e-b75f-7d2e06a2f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Flow 'volume_create_manager' (4e0760ec-3717-4f87-9149-84bd625b8543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-35f68989-4511-41a5-bfdf-7aa8d7549b1e tempest-VolumesListAdminTestJSON-2133451101 None] Created volume successfully. Nov 05 16:11:37 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 1G" returned: 0 in 0.440s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Downloaded image db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume 91ee5b68-6c42-4cae-8a46-39ff1d1ff390 successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 for user 2182c0dd8bc04f288d382c7123e36dd6 is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Marking volume 91ee5b68-6c42-4cae-8a46-39ff1d1ff390 as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Copying metadata from image db5f453d-0d67-42b5-9b27-8a3136fce700 to 91ee5b68-6c42-4cae-8a46-39ff1d1ff390. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Creating volume glance metadata for volume 91ee5b68-6c42-4cae-8a46-39ff1d1ff390 backed by image db5f453d-0d67-42b5-9b27-8a3136fce700 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef98a6c-a686-484e-bbbe-2132c6ca7de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe8f052-9c73-4e60-a065-09dec88adffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Volume volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 (91ee5b68-6c42-4cae-8a46-39ff1d1ff390): created successfully Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe8f052-9c73-4e60-a065-09dec88adffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Flow 'volume_create_manager' (6fb5b5dd-cfe2-45e7-a4ad-1806aa1adb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-afcd9e4e-7790-4953-9cd6-23dde13f7873 tempest-VolumesImageMetadata-1715400922 None] Created volume successfully. Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Flow 'volume_create_manager' (63f87a55-0166-4f4c-a796-5b42bbf4c39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52498ec5-a98f-4614-b9f7-7f7e8f25b5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52498ec5-a98f-4614-b9f7-7f7e8f25b5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1887d2-923a-45c2-88c7-86fa5ac145aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c3d8406f5945cbb3d6e634c60bf8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:39Z,use_quota=True,user_id='e6a479cc10f142ca990965b0781ce966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873ae9a4-3982-469d-86c5-2bd174e8b09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873ae9a4-3982-469d-86c5-2bd174e8b09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5649b30c-9830-45f8-9ab0-becbd4a38482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5649b30c-9830-45f8-9ab0-becbd4a38482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1887d2-923a-45c2-88c7-86fa5ac145aa', 'volume_name': 'volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9894b935-02e2-475d-9b2c-f9655aed22a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9894b935-02e2-475d-9b2c-f9655aed22a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3de2c2-0f92-4887-a73d-7d0e032fe9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Volume 4e1887d2-923a-45c2-88c7-86fa5ac145aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa', 'volume_size': 1} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1887d2-923a-45c2-88c7-86fa5ac145aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c3d8406f5945cbb3d6e634c60bf8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:39Z,use_quota=True,user_id='e6a479cc10f142ca990965b0781ce966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Creating volume 4e1887d2-923a-45c2-88c7-86fa5ac145aa {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:39 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:39 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa 1073741824 Nov 05 16:11:39 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Acquiring lock "cinder-91ee5b68-6c42-4cae-8a46-39ff1d1ff390-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Lock "cinder-91ee5b68-6c42-4cae-8a46-39ff1d1ff390-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Acquiring lock "cinder-quobyte-91ee5b68-6c42-4cae-8a46-39ff1d1ff390" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Lock "cinder-quobyte-91ee5b68-6c42-4cae-8a46-39ff1d1ff390" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f60ef2-ff88-44a9-a6ed-8b304e1b5040]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:39 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 Nov 05 16:11:39 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:40 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa 1073741824" returned: 0 in 0.919s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:40 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa Nov 05 16:11:40 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:40 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390" returned: 0 in 0.474s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:40 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390 Nov 05 16:11:40 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:40 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa" returned: 0 in 0.336s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3de2c2-0f92-4887-a73d-7d0e032fe9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a45e10-e461-4d51-b951-3ecfffdda0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:40 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Volume volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa (4e1887d2-923a-45c2-88c7-86fa5ac145aa): created successfully Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a45e10-e461-4d51-b951-3ecfffdda0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Flow 'volume_create_manager' (63f87a55-0166-4f4c-a796-5b42bbf4c39d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:40 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2a1c051a-fc15-4a7d-99d7-f7dd7fa9d2b5 tempest-VolumesListAdminTestJSON-1054265152 None] Created volume successfully. Nov 05 16:11:40 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-91ee5b68-6c42-4cae-8a46-39ff1d1ff390" returned: 0 in 0.435s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Lock "cinder-quobyte-91ee5b68-6c42-4cae-8a46-39ff1d1ff390" released by "delete_volume" :: held 0.968s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Created reservations ['0a69ced4-b3ef-449a-a9ac-6a214c887688', '0c2d46f6-d1ab-4ded-945a-f2387c045a62', '47e99b2c-882c-4a27-a0c7-07e4f436980c', '1505dbbf-e165-4050-8859-4f6919b4bfa9'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:41 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:41 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Acquiring lock "cinder-4e1887d2-923a-45c2-88c7-86fa5ac145aa-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Lock "cinder-4e1887d2-923a-45c2-88c7-86fa5ac145aa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:41 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.345s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Deleted volume successfully. Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-056572c5-3752-429b-b699-be7ff9eed389 tempest-VolumesImageMetadata-1715400922 None] Lock "cinder-91ee5b68-6c42-4cae-8a46-39ff1d1ff390-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Acquiring lock "cinder-quobyte-4e1887d2-923a-45c2-88c7-86fa5ac145aa" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Lock "cinder-quobyte-4e1887d2-923a-45c2-88c7-86fa5ac145aa" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ed318-06a7-45f7-9eec-654048a3b1c9]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "cinder-fb372cb0-937d-4dc1-8169-92debacb6a68-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-fb372cb0-937d-4dc1-8169-92debacb6a68-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "cinder-quobyte-fb372cb0-937d-4dc1-8169-92debacb6a68" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-quobyte-fb372cb0-937d-4dc1-8169-92debacb6a68" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:41 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa Nov 05 16:11:41 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a78ea1-b51c-47e5-9f5c-227a4300816c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:41 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 Nov 05 16:11:41 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:42 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa" returned: 0 in 0.748s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:42 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa Nov 05 16:11:42 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:42 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68" returned: 0 in 0.772s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:42 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68 Nov 05 16:11:42 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:42 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4e1887d2-923a-45c2-88c7-86fa5ac145aa" returned: 0 in 0.498s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Lock "cinder-quobyte-4e1887d2-923a-45c2-88c7-86fa5ac145aa" released by "delete_volume" :: held 1.328s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Created reservations ['607e375a-4670-41f2-ac4f-26cd91976fde', 'a0d61a35-1de4-4248-a202-d52f58c8ba9e', '910678fe-1ded-4bbf-a472-ccb6f844e8f6', '0d82f961-eb11-466b-9ff7-2341be868127'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:42 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fb372cb0-937d-4dc1-8169-92debacb6a68" returned: 0 in 0.495s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:42 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:42 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-quobyte-fb372cb0-937d-4dc1-8169-92debacb6a68" released by "delete_volume" :: held 1.356s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Created reservations ['75fb8c25-13e8-4a40-b7dc-a162630ce494', '1826e5cb-b6de-4cf4-bee3-881ba3014c3b', '3aacb445-26b7-488c-9223-0368f0267a1a', '95297295-083b-4954-b0b0-c07802dce08e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:43 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:43 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:43 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.397s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Deleted volume successfully. Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a221d302-d992-4799-abc0-94594a4ce87d tempest-VolumesListAdminTestJSON-1054265152 None] Lock "cinder-4e1887d2-923a-45c2-88c7-86fa5ac145aa-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:43 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.330s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Deleted volume successfully. Nov 05 16:11:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b7fb0208-af72-4f62-8685-1f91cd303cc0 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-fb372cb0-937d-4dc1-8169-92debacb6a68-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "cinder-bbdfb4f9-b524-4ebb-937d-8fe882462616-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-bbdfb4f9-b524-4ebb-937d-8fe882462616-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "cinder-quobyte-bbdfb4f9-b524-4ebb-937d-8fe882462616" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-quobyte-bbdfb4f9-b524-4ebb-937d-8fe882462616" acquired by "delete_volume" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5560da-351b-4992-9982-7d902a14a60d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:44 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 Nov 05 16:11:44 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:44 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616" returned: 0 in 0.605s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:44 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616 Nov 05 16:11:44 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:45 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bbdfb4f9-b524-4ebb-937d-8fe882462616" returned: 0 in 0.324s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-quobyte-bbdfb4f9-b524-4ebb-937d-8fe882462616" released by "delete_volume" :: held 1.019s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Created reservations ['fb9e9ecb-a785-4b66-b1ee-35690da6e584', '1c9ab8a0-55f2-4a08-9d68-ffad92f5d117', 'c39b33a0-da88-4b81-8844-c667908cfe7f', 'baa32ebf-76c3-4b33-a6f2-e3f559de68d0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:45 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:45 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:45 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.357s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Deleted volume successfully. Nov 05 16:11:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab59552-ecc1-4873-86e4-124fb7b52ede tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-bbdfb4f9-b524-4ebb-937d-8fe882462616-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "cinder-e285e919-b568-4d95-8e87-8fa3b7766b17-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-e285e919-b568-4d95-8e87-8fa3b7766b17-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "cinder-quobyte-e285e919-b568-4d95-8e87-8fa3b7766b17" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-quobyte-e285e919-b568-4d95-8e87-8fa3b7766b17" acquired by "delete_volume" :: waited 0.035s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c3eda4-5c4b-4388-be1c-2254afacf15f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:47 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 Nov 05 16:11:47 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:47 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17" returned: 0 in 0.805s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:47 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17 Nov 05 16:11:47 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:47 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e285e919-b568-4d95-8e87-8fa3b7766b17" returned: 0 in 0.436s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-quobyte-e285e919-b568-4d95-8e87-8fa3b7766b17" released by "delete_volume" :: held 1.327s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Created reservations ['d3d6dea1-f741-456d-adb5-ebd018c64405', '4d950b1f-16b1-403f-b7b1-b147763e61c5', '9f85de99-f1c9-4ba4-a9c4-8228dc6f5245', '22ac0d61-023b-49f0-8d6b-119382c4d387'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:48 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:48 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:48 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.384s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:48 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Deleted volume successfully. Nov 05 16:11:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-072b83ef-57f1-4f56-8903-f939a302c6a7 tempest-VolumesListAdminTestJSON-2133451101 None] Lock "cinder-e285e919-b568-4d95-8e87-8fa3b7766b17-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Flow 'volume_create_manager' (752eca58-bdb9-4fd8-97fb-a84895a82a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ba0afc-48fc-4fde-83a0-4023fdf04e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ba0afc-48fc-4fde-83a0-4023fdf04e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1732444747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9715ed-1940-4738-bc10-f09e378af933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a0b83643348baad16a046ca174116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:49Z,use_quota=True,user_id='005a4ffa50d74dfa847a9e3b2544fca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feed5d8c-900f-49e0-bd37-18847832c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feed5d8c-900f-49e0-bd37-18847832c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a470183-4b9a-49e4-bc75-36bcefa14ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a470183-4b9a-49e4-bc75-36bcefa14ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc9715ed-1940-4738-bc10-f09e378af933', 'volume_name': 'volume-fc9715ed-1940-4738-bc10-f09e378af933', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565fb7d1-cb4f-4318-a318-db4f73f3cb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565fb7d1-cb4f-4318-a318-db4f73f3cb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6518cfce-ab1d-48d1-a9c5-ad5aeab50410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:49 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Volume fc9715ed-1940-4738-bc10-f09e378af933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc9715ed-1940-4738-bc10-f09e378af933', 'volume_size': 1} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1732444747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9715ed-1940-4738-bc10-f09e378af933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95a0b83643348baad16a046ca174116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:49Z,use_quota=True,user_id='005a4ffa50d74dfa847a9e3b2544fca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Creating volume fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:49 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:49 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 1073741824 Nov 05 16:11:49 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:50 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 1073741824" returned: 0 in 0.700s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:50 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:11:50 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:50 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 Nov 05 16:11:50 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:50 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6518cfce-ab1d-48d1-a9c5-ad5aeab50410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9715ed-1940-4738-bc10-f09e378af933', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155f25c9-22be-4b64-b3a7-7f4febfc79fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:50 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Volume volume-fc9715ed-1940-4738-bc10-f09e378af933 (fc9715ed-1940-4738-bc10-f09e378af933): created successfully Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155f25c9-22be-4b64-b3a7-7f4febfc79fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Flow 'volume_create_manager' (752eca58-bdb9-4fd8-97fb-a84895a82a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:50 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-381eb665-277e-4071-818e-033f88682d67 tempest-SnapshotMetadataTestJSON-701884135 None] Created volume successfully. Nov 05 16:11:50 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.554s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:11:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:11:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Creating offline snapshot 6c938c92-0313-43fe-a1ae-b75987f2597e of volume fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:11:51 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5b8ec0-7ab1-4e3a-9acb-a5e31d1c7060]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:51 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 Nov 05 16:11:51 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:52 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933" returned: 0 in 0.479s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:52 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e 1G Nov 05 16:11:52 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:53 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e 1G" returned: 0 in 1.099s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9715ed-1940-4738-bc10-f09e378af933 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:53 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9715ed-1940-4738-bc10-f09e378af933 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e Nov 05 16:11:53 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:54 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9715ed-1940-4738-bc10-f09e378af933 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e" returned: 0 in 0.748s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:54 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e is being set with open permissions: ugo+rw Nov 05 16:11:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:54 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e Nov 05 16:11:54 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:54 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e" returned: 0 in 0.397s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:54 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.info Nov 05 16:11:54 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:55 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.info" returned: 0 in 0.516s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:55 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.info is being set with open permissions: ugo+rw Nov 05 16:11:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:55 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.info Nov 05 16:11:55 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:55 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.info" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.768s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e4798874-01c1-4aeb-bc8a-115076568ec1 tempest-SnapshotMetadataTestJSON-701884135 None] Create snapshot completed successfully Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "cinder-6c938c92-0313-43fe-a1ae-b75987f2597e-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-6c938c92-0313-43fe-a1ae-b75987f2597e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "cinder-quobyte-fc9715ed-1940-4738-bc10-f09e378af933" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-quobyte-fc9715ed-1940-4738-bc10-f09e378af933" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "cinder-quobyte-6c938c92-0313-43fe-a1ae-b75987f2597e" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-quobyte-6c938c92-0313-43fe-a1ae-b75987f2597e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Deleting offline snapshot 6c938c92-0313-43fe-a1ae-b75987f2597e of volume fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] snapshot_file for this snap is: volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3835682-73d3-4745-90b3-6869a076cae7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:57 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e Nov 05 16:11:57 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Flow 'volume_create_manager' (1e869c21-9e35-44e5-8d5f-7354ee43b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4575d250-11ea-42f4-8493-20899c173053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4575d250-11ea-42f4-8493-20899c173053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2074505322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c765166-e8d3-4d91-9377-bf58a39c5381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50362fd4519c4e9c8531a14ccb66403d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:58Z,use_quota=True,user_id='89cd64a8dd6d4437ac337e9858689841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef379fb-c287-4ba2-93fd-55c25e0ee42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef379fb-c287-4ba2-93fd-55c25e0ee42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d121b59-fa2a-4375-884d-2cd44d750d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d121b59-fa2a-4375-884d-2cd44d750d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c765166-e8d3-4d91-9377-bf58a39c5381', 'volume_name': 'volume-5c765166-e8d3-4d91-9377-bf58a39c5381', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba1992-3d96-4fd8-8ebf-9815d9e1b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba1992-3d96-4fd8-8ebf-9815d9e1b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f83bad7-bfbd-4644-8ce3-450c7f3ce5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:58 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Volume 5c765166-e8d3-4d91-9377-bf58a39c5381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c765166-e8d3-4d91-9377-bf58a39c5381', 'volume_size': 1} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2074505322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c765166-e8d3-4d91-9377-bf58a39c5381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50362fd4519c4e9c8531a14ccb66403d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:11:58Z,use_quota=True,user_id='89cd64a8dd6d4437ac337e9858689841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Creating volume 5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:11:58 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:58 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 1073741824 Nov 05 16:11:58 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:58 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e" returned: 0 in 0.499s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc9715ed-1940-4738-bc10-f09e378af933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade966e-c6cd-4723-8f55-4a1fe7faa7fe]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:58 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 Nov 05 16:11:58 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:58 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 1073741824" returned: 0 in 0.605s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:58 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933" returned: 0 in 0.499s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:58 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e Nov 05 16:11:58 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:58 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 Nov 05 16:11:58 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:59 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381" returned: 0 in 0.327s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f83bad7-bfbd-4644-8ce3-450c7f3ce5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c765166-e8d3-4d91-9377-bf58a39c5381', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28649447-328c-4ad4-8797-61997b6b07c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:11:59 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Volume volume-5c765166-e8d3-4d91-9377-bf58a39c5381 (5c765166-e8d3-4d91-9377-bf58a39c5381): created successfully Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28649447-328c-4ad4-8797-61997b6b07c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Flow 'volume_create_manager' (1e869c21-9e35-44e5-8d5f-7354ee43b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:11:59 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e" returned: 0 in 0.450s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6da99edc-7340-4b99-b6e0-6522e1fcba60 tempest-VolumesDeleteCascade-2012203333 None] Created volume successfully. Nov 05 16:11:59 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e Nov 05 16:11:59 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:11:59 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933.6c938c92-0313-43fe-a1ae-b75987f2597e" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-quobyte-6c938c92-0313-43fe-a1ae-b75987f2597e" released by "_delete_snapshot" :: held 1.857s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-quobyte-fc9715ed-1940-4738-bc10-f09e378af933" released by "delete_snapshot" :: held 1.887s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Created reservations ['10311bd4-bd6e-4001-a0ff-e5a9a2a9fc44', 'b4a9ae43-3219-4385-bc6d-b303df90af0f', 'ecacf018-7e03-4fea-a41c-1fee6625684f', 'a68128c5-1c4f-4bf8-85af-f57a326eaa73'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:11:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Delete snapshot completed successfully. Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1025a59e-acb9-4b09-9f24-35a36b1e3888 tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-6c938c92-0313-43fe-a1ae-b75987f2597e-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "cinder-fc9715ed-1940-4738-bc10-f09e378af933-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-fc9715ed-1940-4738-bc10-f09e378af933-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "cinder-quobyte-fc9715ed-1940-4738-bc10-f09e378af933" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-quobyte-fc9715ed-1940-4738-bc10-f09e378af933" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8852fc17-bfc6-4fb8-9ff6-1b6e770d8ca3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:11:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:11:59 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 Nov 05 16:11:59 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Creating offline snapshot 89127721-c4c3-4e3f-b834-69e7bb5560db of volume 5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7fcda9-a797-4703-9658-c06ee146baab]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:00 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933" returned: 0 in 0.413s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:00 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 Nov 05 16:12:00 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:00 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933 Nov 05 16:12:00 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:00 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-fc9715ed-1940-4738-bc10-f09e378af933" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-quobyte-fc9715ed-1940-4738-bc10-f09e378af933" released by "delete_volume" :: held 0.732s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:00 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:00 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db 1G Nov 05 16:12:00 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Created reservations ['019439fb-fdc7-4c9e-b741-3e3056c21f5e', '4324e026-6ac0-435c-83d3-e1d447f7067c', 'e6b426dd-e2aa-4f73-91e2-9d6b93a3b677', '743f9e78-cb1d-49d6-b512-e8af622a064c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:00 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:00 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:00 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.269s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:00 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Deleted volume successfully. Nov 05 16:12:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-37132567-08d0-4f79-b779-03c604c770ae tempest-SnapshotMetadataTestJSON-701884135 None] Lock "cinder-fc9715ed-1940-4738-bc10-f09e378af933-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:01 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db 1G" returned: 0 in 0.489s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c765166-e8d3-4d91-9377-bf58a39c5381 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:01 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c765166-e8d3-4d91-9377-bf58a39c5381 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db Nov 05 16:12:01 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:01 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c765166-e8d3-4d91-9377-bf58a39c5381 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:01 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db is being set with open permissions: ugo+rw Nov 05 16:12:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:01 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db Nov 05 16:12:01 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:01 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db" returned: 0 in 0.309s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:01 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.info Nov 05 16:12:01 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:02 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.info" returned: 0 in 0.445s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:02 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.info is being set with open permissions: ugo+rw Nov 05 16:12:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:02 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.info Nov 05 16:12:02 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:02 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.info" returned: 0 in 0.314s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a81033f3-2e1b-4ff0-84da-0e5a57072cd1 tempest-VolumesDeleteCascade-2012203333 None] Create snapshot completed successfully Nov 05 16:12:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Creating offline snapshot 4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 of volume 5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:12:03 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4b0767-64db-4e00-920c-8d6b0613efd2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:03 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db Nov 05 16:12:03 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:04 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db" returned: 0 in 0.475s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c765166-e8d3-4d91-9377-bf58a39c5381(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:12:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:04 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 1G Nov 05 16:12:04 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:04 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 1G" returned: 0 in 0.500s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:04 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 Nov 05 16:12:04 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:04 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" returned: 0 in 0.301s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:04 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 is being set with open permissions: ugo+rw Nov 05 16:12:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:05 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 Nov 05 16:12:05 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:05 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.688s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5bfd11d7-2561-4496-913f-b9a69fd4192c tempest-VolumesDeleteCascade-2012203333 None] Create snapshot completed successfully Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-5c765166-e8d3-4d91-9377-bf58a39c5381-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-5c765166-e8d3-4d91-9377-bf58a39c5381-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Performing cascade delete. {{(pid=86924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Deleting offline snapshot 4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 of volume 5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] snapshot_file for this snap is: volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0fcc2-1541-4810-bdf2-6525acecd3d4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:06 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 Nov 05 16:12:06 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Flow 'volume_create_manager' (3f080713-e5f4-43eb-a428-32911a955d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c291104a-146e-46f7-8b22-6625c4910d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c291104a-146e-46f7-8b22-6625c4910d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-548979600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1878b81c-1b24-4a3f-8f8f-2f96bfce97b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682b96fcc18a454ca33131228ecc9c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:06Z,use_quota=True,user_id='d0092b75b6914624847d6414ebc13536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ca47d0-9936-46e2-ba2a-028094694f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ca47d0-9936-46e2-ba2a-028094694f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fe2f09-5dfd-4fde-b671-f8eed4955648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fe2f09-5dfd-4fde-b671-f8eed4955648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1878b81c-1b24-4a3f-8f8f-2f96bfce97b3', 'volume_name': 'volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6bdec1-fdac-43df-8f82-b0a207f42ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6bdec1-fdac-43df-8f82-b0a207f42ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c44a81-7c0f-484f-9068-0bc9c8e472ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:06 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Volume 1878b81c-1b24-4a3f-8f8f-2f96bfce97b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3', 'volume_size': 1} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-548979600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1878b81c-1b24-4a3f-8f8f-2f96bfce97b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682b96fcc18a454ca33131228ecc9c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:06Z,use_quota=True,user_id='d0092b75b6914624847d6414ebc13536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Creating volume 1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:06 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:06 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" returned: 0 in 0.509s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c765166-e8d3-4d91-9377-bf58a39c5381(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:12:06 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 1073741824 Nov 05 16:12:06 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfeff5c-432b-4c99-9769-db445d2888e3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:06 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db Nov 05 16:12:06 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:07 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:07 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db" returned: 0 in 0.589s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 1073741824" returned: 0 in 0.651s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c765166-e8d3-4d91-9377-bf58a39c5381(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:07 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 Nov 05 16:12:07 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:07 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 Nov 05 16:12:07 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:07 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3" returned: 0 in 0.515s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c44a81-7c0f-484f-9068-0bc9c8e472ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba2ab93-85a4-4442-8673-993251a97921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:07 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Volume volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 (1878b81c-1b24-4a3f-8f8f-2f96bfce97b3): created successfully Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba2ab93-85a4-4442-8673-993251a97921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Flow 'volume_create_manager' (3f080713-e5f4-43eb-a428-32911a955d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c4a1a51a-fa09-4ada-89f8-db0829fde5cc tempest-AbsoluteLimitsTests-1915901258 None] Created volume successfully. Nov 05 16:12:08 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" returned: 0 in 0.888s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:08 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7 Nov 05 16:12:08 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:08 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7" released by "_delete_snapshot" :: held 2.364s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" released by "delete_snapshot" :: held 2.396s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Created reservations ['305f5086-1a50-427c-bda2-fde44b432566', '0411062b-f9fe-476d-a904-8aa952c7f348', '21d6f438-d8eb-419e-ae6c-0c5757e8fd95', '3d78512c-e2f0-46f9-b2b9-3faf8b12ffb4'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:08 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Delete snapshot completed successfully. Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-4ba01a40-c953-4a84-b3a0-5d7fe52e9ec7-delete_snapshot" released by "delete_snapshot" :: held 2.548s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-89127721-c4c3-4e3f-b834-69e7bb5560db-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-89127721-c4c3-4e3f-b834-69e7bb5560db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-89127721-c4c3-4e3f-b834-69e7bb5560db" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-89127721-c4c3-4e3f-b834-69e7bb5560db" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Deleting offline snapshot 89127721-c4c3-4e3f-b834-69e7bb5560db of volume 5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] snapshot_file for this snap is: volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335f61b-68dd-4a26-b8a9-cf6533265291]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:08 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db Nov 05 16:12:08 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Acquiring lock "cinder-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Lock "cinder-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Acquiring lock "cinder-quobyte-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Lock "cinder-quobyte-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b624af-d222-4d59-939a-19011b1390f9]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:09 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db" returned: 0 in 0.511s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c765166-e8d3-4d91-9377-bf58a39c5381(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[25266090-fb99-4c71-9f52-e9f2d501b925]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:09 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 Nov 05 16:12:09 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:09 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 Nov 05 16:12:09 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:09 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3" returned: 0 in 0.440s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:09 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3 Nov 05 16:12:09 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:09 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381" returned: 0 in 0.436s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:09 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db Nov 05 16:12:09 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:09 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3" returned: 0 in 0.249s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Lock "cinder-quobyte-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3" released by "delete_volume" :: held 0.743s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Created reservations ['1b4eab10-0538-4342-8c01-499d5b2dc22b', 'c9d17dbf-6135-4ca9-812f-3e13f31e940d', '6927e6c0-381b-4897-a502-0985a862946a', '51c6ac50-0497-4a06-bdc3-eea92543f577'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:09 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:09 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:10 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:10 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db Nov 05 16:12:10 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:10 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.309s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:10 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Deleted volume successfully. Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-036caeeb-4521-4233-85a8-86dd14e4f0f4 tempest-AbsoluteLimitsTests-1915901258 None] Lock "cinder-1878b81c-1b24-4a3f-8f8f-2f96bfce97b3-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:10 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381.89127721-c4c3-4e3f-b834-69e7bb5560db" returned: 0 in 0.371s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-89127721-c4c3-4e3f-b834-69e7bb5560db" released by "_delete_snapshot" :: held 1.871s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" released by "delete_snapshot" :: held 1.896s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Created reservations ['f774e731-ceef-4bfd-b55b-6a49fa88234f', '7750a785-1a4a-47f1-997c-56c406933431', 'b46612e1-a231-479b-a883-f75a40d49ae6', '371649a9-3433-44f7-a490-e6cd7522cabf'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:10 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Delete snapshot completed successfully. Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-89127721-c4c3-4e3f-b834-69e7bb5560db-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Snapshots deleted, issuing volume delete {{(pid=86924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb5a0f3-04d9-4f35-8a1c-4d2fba017c7a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:10 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 Nov 05 16:12:10 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:11 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381" returned: 0 in 0.401s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:11 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381 Nov 05 16:12:11 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:11 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c765166-e8d3-4d91-9377-bf58a39c5381" returned: 0 in 0.313s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-5c765166-e8d3-4d91-9377-bf58a39c5381" released by "delete_volume" :: held 0.793s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Created reservations ['8a776468-1e14-4093-83d9-1433fa79d165', '956d3a2a-448d-4f16-b5e0-39766616a1a7', 'e91746d6-a48e-4692-98fd-8097c71e8145', '468e815c-a070-46dc-82ea-f572857ed010'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-f764a7dc-7adc-47a1-a3f5-79f25c7b6f4a req-b0b677cd-d954-4610-b859-5b6ea3c38669 tempest-AttachVolumeNegativeTest-129395497 None] Terminate volume connection completed successfully. Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-f764a7dc-7adc-47a1-a3f5-79f25c7b6f4a req-b0b677cd-d954-4610-b859-5b6ea3c38669 tempest-AttachVolumeNegativeTest-129395497 None] Deleting attachment b3dc4308-f687-4f21-8d6c-563c3a05e776. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:12:11 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:11 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:11 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Deleted volume successfully. Nov 05 16:12:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-edce6a02-0f17-4179-ad05-f88654ba8024 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-5c765166-e8d3-4d91-9377-bf58a39c5381-delete_volume" released by "delete_volume" :: held 6.071s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Flow 'volume_create_manager' (5acdcfff-44cc-48ed-8868-18ced3179bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114eced9-973b-4d1c-9f24-2323701fa9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114eced9-973b-4d1c-9f24-2323701fa9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-904005619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c95a71-0034-40e5-8d47-e87c378a1b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50362fd4519c4e9c8531a14ccb66403d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:14Z,use_quota=True,user_id='89cd64a8dd6d4437ac337e9858689841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ab627c-8c0b-4b41-a395-da2b60f50ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ab627c-8c0b-4b41-a395-da2b60f50ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ab13b1-a0b0-4981-a464-1ae8d3d96f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ab13b1-a0b0-4981-a464-1ae8d3d96f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c95a71-0034-40e5-8d47-e87c378a1b8b', 'volume_name': 'volume-48c95a71-0034-40e5-8d47-e87c378a1b8b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ceb5e1-0af1-4607-8dd1-d3506615158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ceb5e1-0af1-4607-8dd1-d3506615158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83170d1f-5918-4c74-8010-34569b4d00c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:14 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Volume 48c95a71-0034-40e5-8d47-e87c378a1b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c95a71-0034-40e5-8d47-e87c378a1b8b', 'volume_size': 1} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-904005619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c95a71-0034-40e5-8d47-e87c378a1b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50362fd4519c4e9c8531a14ccb66403d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:14Z,use_quota=True,user_id='89cd64a8dd6d4437ac337e9858689841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Creating volume 48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:14 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:14 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b 1073741824 Nov 05 16:12:14 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:14 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b 1073741824" returned: 0 in 0.722s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:14 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b Nov 05 16:12:14 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:15 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b" returned: 0 in 0.437s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83170d1f-5918-4c74-8010-34569b4d00c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c95a71-0034-40e5-8d47-e87c378a1b8b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59aca094-252d-4ff7-970e-67834ec9db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Volume volume-48c95a71-0034-40e5-8d47-e87c378a1b8b (48c95a71-0034-40e5-8d47-e87c378a1b8b): created successfully Nov 05 16:12:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59aca094-252d-4ff7-970e-67834ec9db5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Flow 'volume_create_manager' (5acdcfff-44cc-48ed-8868-18ced3179bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-596a9195-f64e-4da0-a97e-bb5a705926e8 tempest-VolumesDeleteCascade-2012203333 None] Created volume successfully. Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=113,cinder:UPDATE=123,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=135,cinder:SELECT=103,cinder:INSERT=38,cinder:DELETE=14 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Creating offline snapshot 1f5cf241-6a8c-4b89-b71e-2acfc0e55168 of volume 48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d05347-3588-4bc3-bc15-29626d80f6be]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:16 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b Nov 05 16:12:16 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:16 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b" returned: 0 in 0.412s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:16 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 1G Nov 05 16:12:16 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:17 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 1G" returned: 0 in 0.517s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c95a71-0034-40e5-8d47-e87c378a1b8b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:17 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c95a71-0034-40e5-8d47-e87c378a1b8b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 Nov 05 16:12:17 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Flow 'volume_create_manager' (aa201830-a241-4f9a-9901-6096a6a53de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390c8dfd-b627-4aff-8b82-e1230840f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390c8dfd-b627-4aff-8b82-e1230840f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-637414971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d9e40-62a4-4dac-8365-96b65a0bbcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660d8b4311044912a91a976e4dc7cbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:17Z,use_quota=True,user_id='c6838f910b784ce8879ce69d3dbff523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fac836-8097-4f69-b34e-eaf820c01915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fac836-8097-4f69-b34e-eaf820c01915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87deb283-5115-40b7-8b15-2987dde6ec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87deb283-5115-40b7-8b15-2987dde6ec7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '256d9e40-62a4-4dac-8365-96b65a0bbcdc', 'volume_name': 'volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:17 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cb7e17-9b9e-4fe5-83b8-c67510a70112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cb7e17-9b9e-4fe5-83b8-c67510a70112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f3e9c2-9290-4698-af24-e6f62392ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Volume 256d9e40-62a4-4dac-8365-96b65a0bbcdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Trying to clone 256d9e40-62a4-4dac-8365-96b65a0bbcdc from image db5f453d-0d67-42b5-9b27-8a3136fce700 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c95a71-0034-40e5-8d47-e87c378a1b8b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168" returned: 0 in 0.400s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:17 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 is being set with open permissions: ugo+rw Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:17 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 Nov 05 16:12:17 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:12:17 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Image download 20.69 MB at 20.69 MB/s Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:17 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab49ec54-1f26-40fc-933e-ac4ff1f14d01]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:17 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.info Nov 05 16:12:17 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:18 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD Nov 05 16:12:18 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:18 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.info" returned: 0 in 0.293s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:18 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.info is being set with open permissions: ugo+rw Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:18 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.info Nov 05 16:12:18 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:18 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 is fetched for user c6838f910b784ce8879ce69d3dbff523. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f600cfd4-d55d-4001-afdc-c52745f1fa82]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:18 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.info" returned: 0 in 0.278s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f78e373b-3c48-431f-bd27-028404feb27a tempest-VolumesDeleteCascade-2012203333 None] Create snapshot completed successfully Nov 05 16:12:18 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD Nov 05 16:12:18 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:18 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-637414971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d9e40-62a4-4dac-8365-96b65a0bbcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660d8b4311044912a91a976e4dc7cbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:17Z,use_quota=True,user_id='c6838f910b784ce8879ce69d3dbff523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Creating volume 256d9e40-62a4-4dac-8365-96b65a0bbcdc {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:18 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:18 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 1073741824 Nov 05 16:12:18 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Flow 'volume_create_manager' (1b049a56-6c71-4797-8272-7267a17e0e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebecb2e4-1831-4c3d-9e3e-524b7acb4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebecb2e4-1831-4c3d-9e3e-524b7acb4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1948453729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b845b95d97c4004b59ee288a1d3d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:19Z,use_quota=True,user_id='2717a640a1af48ad8ceceb2b48802254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021d7435-9625-45d5-8ddc-f730ef7999e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (021d7435-9625-45d5-8ddc-f730ef7999e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af3698-af93-4a02-a566-d1da53aece0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af3698-af93-4a02-a566-d1da53aece0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77', 'volume_name': 'volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83f3370-ba8f-4b83-90e8-7f91aec155ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83f3370-ba8f-4b83-90e8-7f91aec155ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4629af-e078-4d94-b9d0-d287674e1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Volume b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77', 'volume_size': 1} Nov 05 16:12:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:19 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 1073741824" returned: 0 in 0.497s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:19 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc Nov 05 16:12:19 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:19 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc" returned: 0 in 0.284s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1948453729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b845b95d97c4004b59ee288a1d3d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:19Z,use_quota=True,user_id='2717a640a1af48ad8ceceb2b48802254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Creating volume b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:19 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:19 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 1073741824 Nov 05 16:12:19 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Attempting download of db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume 256d9e40-62a4-4dac-8365-96b65a0bbcdc. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60457313-1096-4973-b25f-eefc9b0692e3]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_m2hyyj9u {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:19 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_m2hyyj9u Nov 05 16:12:19 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Flow 'volume_create_manager' (8e7b0935-2547-4bad-9736-2eab11fcdac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a27449-8d70-484b-8a08-0acabce3c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a27449-8d70-484b-8a08-0acabce3c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-186610271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68073267-534e-4464-8d1a-497f609dfabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50362fd4519c4e9c8531a14ccb66403d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f5cf241-6a8c-4b89-b71e-2acfc0e55168,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:20Z,use_quota=True,user_id='89cd64a8dd6d4437ac337e9858689841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307fae3f-5e74-43c6-9f61-68b081d55e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307fae3f-5e74-43c6-9f61-68b081d55e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f677a70f-eab7-402a-b0b1-79767e1ebe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f677a70f-eab7-402a-b0b1-79767e1ebe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68073267-534e-4464-8d1a-497f609dfabb', 'volume_name': 'volume-68073267-534e-4464-8d1a-497f609dfabb', 'volume_size': 1, 'snapshot_id': '1f5cf241-6a8c-4b89-b71e-2acfc0e55168'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0268af0e-5ebe-4b0c-ad53-2fe454b9f60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0268af0e-5ebe-4b0c-ad53-2fe454b9f60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0637bf99-1b7a-4eb4-8b9a-877368141ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:20 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Volume 68073267-534e-4464-8d1a-497f609dfabb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68073267-534e-4464-8d1a-497f609dfabb', 'volume_size': 1, 'snapshot_id': '1f5cf241-6a8c-4b89-b71e-2acfc0e55168'} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:20 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_m2hyyj9u" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_m2hyyj9u {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:20 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 1073741824" returned: 0 in 0.556s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:20 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 Nov 05 16:12:20 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:20 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_m2hyyj9u Nov 05 16:12:20 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:20 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.408s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-1f5cf241-6a8c-4b89-b71e-2acfc0e55168-68073267-534e-4464-8d1a-497f609dfabb" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4629af-e078-4d94-b9d0-d287674e1357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd63abd5-9cb0-4e96-a586-48b641f4e9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-1f5cf241-6a8c-4b89-b71e-2acfc0e55168-68073267-534e-4464-8d1a-497f609dfabb" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Creating volume 68073267-534e-4464-8d1a-497f609dfabb from snapshot 1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-68073267-534e-4464-8d1a-497f609dfabb" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:20 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:20 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Volume volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 (b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77): created successfully Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd63abd5-9cb0-4e96-a586-48b641f4e9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Flow 'volume_create_manager' (1b049a56-6c71-4797-8272-7267a17e0e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_m2hyyj9u" returned: 1 in 0.373s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_m2hyyj9u' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81cd65d-c004-4b45-94d8-cabbb15b2206]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-68073267-534e-4464-8d1a-497f609dfabb" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] snapshot: 1f5cf241-6a8c-4b89-b71e-2acfc0e55168, volume: 68073267-534e-4464-8d1a-497f609dfabb, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:12:20 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-167c635d-ec57-42b9-9b98-307387e79bfd tempest-AttachVolumeTestJSON-2058676164 None] Created volume successfully. Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[31306182-01e9-458f-a052-5f3e0bf54124]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:20 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD Nov 05 16:12:20 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:20 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 Nov 05 16:12:20 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:20 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] db5f453d-0d67-42b5-9b27-8a3136fce700 was qcow2, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:12:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:20 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc Nov 05 16:12:20 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:21 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168" returned: 0 in 0.458s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c95a71-0034-40e5-8d47-e87c378a1b8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[057922ae-0063-412b-a2a4-ebbd4a64818d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:21 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b Nov 05 16:12:21 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:21 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b" returned: 0 in 0.501s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:21 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb Nov 05 16:12:21 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-14e38198-474b-4d5b-8dc8-f23f69735832 req-53c479c5-9ff2-4904-b417-ba5cdc7b512c tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:24 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc" returned: 0 in 4.002s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:24 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_peuefd53devstack@QuobyteHD, size 112.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:12:24 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Converted 112.00 MB image at 27.98 MB/s Nov 05 16:12:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:24 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 1G Nov 05 16:12:24 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:25 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 1G" returned: 0 in 0.787s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Downloaded image db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume 256d9e40-62a4-4dac-8365-96b65a0bbcdc successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 for user c6838f910b784ce8879ce69d3dbff523 is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Marking volume 256d9e40-62a4-4dac-8365-96b65a0bbcdc as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Copying metadata from image db5f453d-0d67-42b5-9b27-8a3136fce700 to 256d9e40-62a4-4dac-8365-96b65a0bbcdc. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Creating volume glance metadata for volume 256d9e40-62a4-4dac-8365-96b65a0bbcdc backed by image db5f453d-0d67-42b5-9b27-8a3136fce700 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f3e9c2-9290-4698-af24-e6f62392ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccab317-937e-4fae-a813-6c6e8719f568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:26 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Volume volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc (256d9e40-62a4-4dac-8365-96b65a0bbcdc): created successfully Nov 05 16:12:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccab317-937e-4fae-a813-6c6e8719f568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Flow 'volume_create_manager' (aa201830-a241-4f9a-9901-6096a6a53de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a02b4c2c-5aba-41ba-a24c-717919174485 tempest-VolumesExtendTest-919785826 None] Created volume successfully. Nov 05 16:12:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:30 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb" returned: 0 in 8.975s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:12:30 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Converted 1024.00 MB image at 114.09 MB/s Nov 05 16:12:30 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb is being set with open permissions: ugo+rw Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:30 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb Nov 05 16:12:30 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:30 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-68073267-534e-4464-8d1a-497f609dfabb" released by "_copy_volume_from_snapshot" :: held 10.327s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-1f5cf241-6a8c-4b89-b71e-2acfc0e55168-68073267-534e-4464-8d1a-497f609dfabb" released by "_create_volume_from_snapshot" :: held 10.447s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.484s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-14e38198-474b-4d5b-8dc8-f23f69735832 req-53c479c5-9ff2-4904-b417-ba5cdc7b512c tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.030s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-14e38198-474b-4d5b-8dc8-f23f69735832 req-53c479c5-9ff2-4904-b417-ba5cdc7b512c tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.615s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0637bf99-1b7a-4eb4-8b9a-877368141ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68073267-534e-4464-8d1a-497f609dfabb', 'volume_size': 1, 'snapshot_id': '1f5cf241-6a8c-4b89-b71e-2acfc0e55168'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7a8513-0a59-4d89-87e7-9a542fedc217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e6277-02ce-42b2-b3e9-8b05aef654c3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Volume volume-68073267-534e-4464-8d1a-497f609dfabb (68073267-534e-4464-8d1a-497f609dfabb): created successfully Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7a8513-0a59-4d89-87e7-9a542fedc217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Flow 'volume_create_manager' (8e7b0935-2547-4bad-9736-2eab11fcdac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-14e38198-474b-4d5b-8dc8-f23f69735832 req-53c479c5-9ff2-4904-b417-ba5cdc7b512c tempest-AttachVolumeTestJSON-2058676164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd41fb59e-5e0b-4c4d-bad1-66ab6e7f8c50', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:12:31 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bfb92599-00f8-4d32-a5c9-05cb1c1db91e tempest-VolumesDeleteCascade-2012203333 None] Created volume successfully. Nov 05 16:12:31 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc Nov 05 16:12:31 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:31 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-14e38198-474b-4d5b-8dc8-f23f69735832 req-53c479c5-9ff2-4904-b417-ba5cdc7b512c tempest-AttachVolumeTestJSON-2058676164 None] attachment_update completed successfully. Nov 05 16:12:31 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc" returned: 0 in 0.547s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 2G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc 2G" returned: 0 in 0.155s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.739s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:31 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-02703316-f45a-4cbc-b15b-69b63bed98e4 tempest-VolumesExtendTest-919785826 None] Extend volume completed successfully. Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-48c95a71-0034-40e5-8d47-e87c378a1b8b-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-48c95a71-0034-40e5-8d47-e87c378a1b8b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Performing cascade delete. {{(pid=86924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-1f5cf241-6a8c-4b89-b71e-2acfc0e55168-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-1f5cf241-6a8c-4b89-b71e-2acfc0e55168-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-48c95a71-0034-40e5-8d47-e87c378a1b8b" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-48c95a71-0034-40e5-8d47-e87c378a1b8b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-1f5cf241-6a8c-4b89-b71e-2acfc0e55168" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Acquiring lock "cinder-256d9e40-62a4-4dac-8365-96b65a0bbcdc-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-1f5cf241-6a8c-4b89-b71e-2acfc0e55168" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Deleting offline snapshot 1f5cf241-6a8c-4b89-b71e-2acfc0e55168 of volume 48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] snapshot_file for this snap is: volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Lock "cinder-256d9e40-62a4-4dac-8365-96b65a0bbcdc-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c36d4-cf02-46f9-8e68-056e8247b6fc]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Acquiring lock "cinder-quobyte-256d9e40-62a4-4dac-8365-96b65a0bbcdc" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-256d9e40-62a4-4dac-8365-96b65a0bbcdc" acquired by "delete_volume" :: waited 0.038s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[05485bcc-3b96-4c1c-9074-5b155e006f87]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:33 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 Nov 05 16:12:33 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:33 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc Nov 05 16:12:33 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:33 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168" returned: 0 in 0.626s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c95a71-0034-40e5-8d47-e87c378a1b8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[200457b4-7859-4820-80a5-33bcdd400e0b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:33 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc" returned: 0 in 0.558s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:33 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc Nov 05 16:12:33 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:33 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b Nov 05 16:12:33 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:34 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-256d9e40-62a4-4dac-8365-96b65a0bbcdc" returned: 0 in 0.433s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-256d9e40-62a4-4dac-8365-96b65a0bbcdc" released by "delete_volume" :: held 1.064s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Created reservations ['722e38c4-2d61-4ad8-b9f9-7ca73a53d84e', '4439df15-19a8-4cb8-924d-ec5e8fc42ec0', 'a192da4d-ad8b-41ce-a600-e3667a41192d', 'd1a8fa2e-a7d2-445f-bb52-418b9a3ac5fd'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:34 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:34 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:34 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b" returned: 0 in 0.800s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:34 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 Nov 05 16:12:34 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Flow 'volume_create_manager' (65e974e7-fe2b-4f5a-9f7f-c2cdbe99a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5d13cd-7b08-466a-be34-da6a25fe33c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5d13cd-7b08-466a-be34-da6a25fe33c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-761505175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bafee7a-a269-43ac-9069-ee64f6b7a014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b845b95d97c4004b59ee288a1d3d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:34Z,use_quota=True,user_id='2717a640a1af48ad8ceceb2b48802254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b16d4e-425b-4ff3-a106-e148d8f0ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b16d4e-425b-4ff3-a106-e148d8f0ca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7302bb5e-3c6b-4c64-8190-ff636851cfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7302bb5e-3c6b-4c64-8190-ff636851cfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bafee7a-a269-43ac-9069-ee64f6b7a014', 'volume_name': 'volume-3bafee7a-a269-43ac-9069-ee64f6b7a014', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3b7510-72bd-4ed0-b692-af0efec39262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3b7510-72bd-4ed0-b692-af0efec39262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ffae2-624a-408f-b4b7-e0ba6bbc782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:34 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Volume 3bafee7a-a269-43ac-9069-ee64f6b7a014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bafee7a-a269-43ac-9069-ee64f6b7a014', 'volume_size': 1} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-761505175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bafee7a-a269-43ac-9069-ee64f6b7a014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b845b95d97c4004b59ee288a1d3d4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:34Z,use_quota=True,user_id='2717a640a1af48ad8ceceb2b48802254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Creating volume 3bafee7a-a269-43ac-9069-ee64f6b7a014 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:34 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:34 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 1073741824 Nov 05 16:12:34 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:34 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.303s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:34 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Deleted volume successfully. Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d2c833c8-062b-459a-b35d-984efa8ab158 tempest-VolumesExtendTest-919785826 None] Lock "cinder-256d9e40-62a4-4dac-8365-96b65a0bbcdc-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:34 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168" returned: 0 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:34 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168 Nov 05 16:12:34 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:34 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b.1f5cf241-6a8c-4b89-b71e-2acfc0e55168" returned: 0 in 0.258s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:34 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 1073741824" returned: 0 in 0.496s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:34 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-1f5cf241-6a8c-4b89-b71e-2acfc0e55168" released by "_delete_snapshot" :: held 2.209s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-48c95a71-0034-40e5-8d47-e87c378a1b8b" released by "delete_snapshot" :: held 2.274s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:35 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 Nov 05 16:12:35 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Created reservations ['eb348340-ceb2-47b1-b340-e392c282f0d5', '3b36fbf5-5944-4221-9f6a-0c37b5cc3366', '55e93fb4-bdb3-42c9-ba8f-a47d728b58ef', 'a3c9a61b-ca8c-4b06-9ef3-9fb0e5de96d6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Delete snapshot completed successfully. Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-1f5cf241-6a8c-4b89-b71e-2acfc0e55168-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Snapshots deleted, issuing volume delete {{(pid=86924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-48c95a71-0034-40e5-8d47-e87c378a1b8b" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-48c95a71-0034-40e5-8d47-e87c378a1b8b" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531677b-0c5b-4722-8b52-40cf1592c40e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:35 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ffae2-624a-408f-b4b7-e0ba6bbc782b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bafee7a-a269-43ac-9069-ee64f6b7a014', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d9cb5c-d034-4d3d-aea3-e1fd23a4310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:35 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Volume volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 (3bafee7a-a269-43ac-9069-ee64f6b7a014): created successfully Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d9cb5c-d034-4d3d-aea3-e1fd23a4310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Flow 'volume_create_manager' (65e974e7-fe2b-4f5a-9f7f-c2cdbe99a86a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0033fce6-2972-4b7c-82b1-88c38c4ba0a0 tempest-AttachVolumeTestJSON-2058676164 None] Created volume successfully. Nov 05 16:12:35 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b Nov 05 16:12:35 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:35 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Flow 'volume_create_manager' (7d9b478b-4c01-4b3b-bf48-ca5f0f804fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a640f059-955a-48d4-a95b-0e5ea8ac2e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b" returned: 0 in 0.464s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:35 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b Nov 05 16:12:35 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a640f059-955a-48d4-a95b-0e5ea8ac2e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1167211347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ae9c81-28c2-4da2-8af3-edd0544c7828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660d8b4311044912a91a976e4dc7cbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:36Z,use_quota=True,user_id='c6838f910b784ce8879ce69d3dbff523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b38fdb4-6a8b-47c8-8d98-8fef09df1df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b38fdb4-6a8b-47c8-8d98-8fef09df1df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96236bbd-b107-461c-b13a-0a042aad307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96236bbd-b107-461c-b13a-0a042aad307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ae9c81-28c2-4da2-8af3-edd0544c7828', 'volume_name': 'volume-28ae9c81-28c2-4da2-8af3-edd0544c7828', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9009a5d9-f113-4dfc-8038-cdd9fc582a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9009a5d9-f113-4dfc-8038-cdd9fc582a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b548bcdd-329b-4829-aa93-292d2d0946c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:35 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Volume 28ae9c81-28c2-4da2-8af3-edd0544c7828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ae9c81-28c2-4da2-8af3-edd0544c7828', 'volume_size': 1} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1167211347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ae9c81-28c2-4da2-8af3-edd0544c7828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660d8b4311044912a91a976e4dc7cbbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:36Z,use_quota=True,user_id='c6838f910b784ce8879ce69d3dbff523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Creating volume 28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:35 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:35 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 1073741824 Nov 05 16:12:35 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:35 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-48c95a71-0034-40e5-8d47-e87c378a1b8b" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-48c95a71-0034-40e5-8d47-e87c378a1b8b" released by "delete_volume" :: held 0.804s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Created reservations ['6ac4b52b-b476-48f1-995f-a2eba0e5610b', 'e3c93e95-6263-4a30-913d-809b405f2edd', '9c602e43-c405-4c32-9a78-e06a0277e677', '6ad9fed9-06b7-4fc3-9f50-66f666894f19'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:36 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:36 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:36 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 1073741824" returned: 0 in 0.427s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:36 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 Nov 05 16:12:36 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:36 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.299s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Deleted volume successfully. Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6d5a315a-405a-4922-82a4-c87ab656c7d0 tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-48c95a71-0034-40e5-8d47-e87c378a1b8b-delete_volume" released by "delete_volume" :: held 3.921s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:36 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b548bcdd-329b-4829-aa93-292d2d0946c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ae9c81-28c2-4da2-8af3-edd0544c7828', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5063b1e7-1721-44d9-b62d-2e167df37b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:36 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Volume volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 (28ae9c81-28c2-4da2-8af3-edd0544c7828): created successfully Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5063b1e7-1721-44d9-b62d-2e167df37b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Flow 'volume_create_manager' (7d9b478b-4c01-4b3b-bf48-ca5f0f804fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-94aa9e46-76ec-4034-8b6d-4bc912321be7 tempest-VolumesExtendTest-919785826 None] Created volume successfully. Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Creating offline snapshot edce94d8-6cda-48c0-a14d-2a57e10d8030 of volume 28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[944caacc-69c9-485b-ac8b-648d651bad5a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:37 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 Nov 05 16:12:37 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-68073267-534e-4464-8d1a-497f609dfabb-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-68073267-534e-4464-8d1a-497f609dfabb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "cinder-quobyte-68073267-534e-4464-8d1a-497f609dfabb" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-68073267-534e-4464-8d1a-497f609dfabb" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da42cf6-940f-4b3d-a523-c267a200670b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:37 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828" returned: 0 in 0.542s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:37 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb Nov 05 16:12:37 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:37 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 1G Nov 05 16:12:37 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-c4722017-5d47-4a06-ada2-5b7f341acb13 req-6196bfc1-6b12-4c2a-b13c-036bddcaee79 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:37 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb" returned: 0 in 0.420s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:37 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb Nov 05 16:12:37 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:38 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 1G" returned: 0 in 0.444s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:38 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 Nov 05 16:12:38 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:38 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68073267-534e-4464-8d1a-497f609dfabb" returned: 0 in 0.271s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-quobyte-68073267-534e-4464-8d1a-497f609dfabb" released by "delete_volume" :: held 0.754s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Created reservations ['ea8fb925-24cc-48b9-b244-91620cb5593c', 'ccce2a8a-2fc8-4864-bc92-9920f141d3c4', '9688081b-0863-4697-92ee-9b37e405e59d', '53275f06-8f03-4b15-b9fa-2ec3d1845fb0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:38 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:38 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:38 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030" returned: 0 in 0.334s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:38 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 is being set with open permissions: ugo+rw Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:38 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 Nov 05 16:12:38 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:38 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.364s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Deleted volume successfully. Nov 05 16:12:38 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030" returned: 0 in 0.346s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1a511e6c-9fa0-42b0-9ad2-932b6bfd518a tempest-VolumesDeleteCascade-2012203333 None] Lock "cinder-68073267-534e-4464-8d1a-497f609dfabb-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:38 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.info Nov 05 16:12:38 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:39 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.info" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:39 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.info is being set with open permissions: ugo+rw Nov 05 16:12:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:39 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.info Nov 05 16:12:39 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:39 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.info" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-c4722017-5d47-4a06-ada2-5b7f341acb13 req-6196bfc1-6b12-4c2a-b13c-036bddcaee79 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.647s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-c4722017-5d47-4a06-ada2-5b7f341acb13 req-6196bfc1-6b12-4c2a-b13c-036bddcaee79 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-117c6162-fbd9-4eaa-9ba6-54e2cf251375 tempest-VolumesExtendTest-919785826 None] Create snapshot completed successfully Nov 05 16:12:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-c4722017-5d47-4a06-ada2-5b7f341acb13 req-6196bfc1-6b12-4c2a-b13c-036bddcaee79 tempest-AttachVolumeTestJSON-2058676164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-3bafee7a-a269-43ac-9069-ee64f6b7a014', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9563e1b-6eef-4d79-948d-3ecf8b21107b', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:12:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-c4722017-5d47-4a06-ada2-5b7f341acb13 req-6196bfc1-6b12-4c2a-b13c-036bddcaee79 tempest-AttachVolumeTestJSON-2058676164 None] attachment_update completed successfully. Nov 05 16:12:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b11407-8459-4285-a226-6af9225465e8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:40 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 Nov 05 16:12:40 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:40 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828" returned: 0 in 0.465s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 2G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 2G" returned: 0 in 0.212s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.727s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1c068bca-f064-4347-a955-5b292116c6de tempest-VolumesExtendTest-919785826 None] Extend volume completed successfully. Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Acquiring lock "cinder-edce94d8-6cda-48c0-a14d-2a57e10d8030-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Lock "cinder-edce94d8-6cda-48c0-a14d-2a57e10d8030-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Acquiring lock "cinder-quobyte-28ae9c81-28c2-4da2-8af3-edd0544c7828" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-28ae9c81-28c2-4da2-8af3-edd0544c7828" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Acquiring lock "cinder-quobyte-edce94d8-6cda-48c0-a14d-2a57e10d8030" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-edce94d8-6cda-48c0-a14d-2a57e10d8030" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Deleting offline snapshot edce94d8-6cda-48c0-a14d-2a57e10d8030 of volume 28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] snapshot_file for this snap is: volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf99f3-c7a9-4f4a-b5ef-6d2be86b9101]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:41 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 Nov 05 16:12:41 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-76cfaba9-cd06-4b8c-9337-d0322b28e1ec req-ce273c97-9f8e-4be9-942e-1a577e458aaa tempest-AttachVolumeTestJSON-2058676164 None] Terminate volume connection completed successfully. Nov 05 16:12:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-76cfaba9-cd06-4b8c-9337-d0322b28e1ec req-ce273c97-9f8e-4be9-942e-1a577e458aaa tempest-AttachVolumeTestJSON-2058676164 None] Deleting attachment d41fb59e-5e0b-4c4d-bad1-66ab6e7f8c50. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:12:42 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28ae9c81-28c2-4da2-8af3-edd0544c7828(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[10984dd8-96bc-4339-9ff2-c22ecf7e9a98]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:42 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 Nov 05 16:12:42 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:42 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828" returned: 0 in 0.370s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:42 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 Nov 05 16:12:42 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:42 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030" returned: 0 in 0.465s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:42 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030 Nov 05 16:12:42 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Flow 'volume_create_manager' (5201d080-394e-4561-84c7-5fbe3cd6fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:43 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b6e7a8-b8c7-4854-b696-8de3d6b2d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828.edce94d8-6cda-48c0-a14d-2a57e10d8030" returned: 0 in 0.303s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b6e7a8-b8c7-4854-b696-8de3d6b2d414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-196019754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b668aa87-164e-403e-b974-21a23efff04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6a7e8bd77f4df0beae5dc802e12f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:43Z,use_quota=True,user_id='28ae8127a12d4f658e2753360b42b6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993e7562-dd15-44e8-8f5e-34a88078c590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993e7562-dd15-44e8-8f5e-34a88078c590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba455989-754f-4f97-932e-3459d8204498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba455989-754f-4f97-932e-3459d8204498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b668aa87-164e-403e-b974-21a23efff04b', 'volume_name': 'volume-b668aa87-164e-403e-b974-21a23efff04b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b90a53-0aeb-4a6c-9711-d1fb95121db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b90a53-0aeb-4a6c-9711-d1fb95121db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d585306f-b224-461a-b4bd-86bb44cecda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Volume b668aa87-164e-403e-b974-21a23efff04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b668aa87-164e-403e-b974-21a23efff04b', 'volume_size': 1} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-196019754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b668aa87-164e-403e-b974-21a23efff04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6a7e8bd77f4df0beae5dc802e12f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:43Z,use_quota=True,user_id='28ae8127a12d4f658e2753360b42b6f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Creating volume b668aa87-164e-403e-b974-21a23efff04b {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:43 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:43 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b 1073741824 Nov 05 16:12:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-04ed8ccb-fda8-446b-9ca9-e1042601432a req-b19f02c0-488e-43cc-bdb1-bea97871ef4b tempest-AttachVolumeTestJSON-2058676164 None] Terminate volume connection completed successfully. Nov 05 16:12:43 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-04ed8ccb-fda8-446b-9ca9-e1042601432a req-b19f02c0-488e-43cc-bdb1-bea97871ef4b tempest-AttachVolumeTestJSON-2058676164 None] Deleting attachment b9563e1b-6eef-4d79-948d-3ecf8b21107b. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-edce94d8-6cda-48c0-a14d-2a57e10d8030" released by "_delete_snapshot" :: held 1.787s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-28ae9c81-28c2-4da2-8af3-edd0544c7828" released by "delete_snapshot" :: held 1.811s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Created reservations ['dc48351c-3b6d-49ec-81b8-91ffe315912b', '3cc8bd6a-2c2d-4e0e-b318-0a0015910aa9', '65297b44-d89d-4a23-9b22-e17e711e9f7d', '15767b7d-5e19-4a3e-93b3-4d993642ea43'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Delete snapshot completed successfully. Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0abc503-5e87-4c05-91ba-909afabc1758 tempest-VolumesExtendTest-919785826 None] Lock "cinder-edce94d8-6cda-48c0-a14d-2a57e10d8030-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:43 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b 1073741824" returned: 0 in 0.451s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Acquiring lock "cinder-28ae9c81-28c2-4da2-8af3-edd0544c7828-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:43 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b Nov 05 16:12:43 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Lock "cinder-28ae9c81-28c2-4da2-8af3-edd0544c7828-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Acquiring lock "cinder-quobyte-28ae9c81-28c2-4da2-8af3-edd0544c7828" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-28ae9c81-28c2-4da2-8af3-edd0544c7828" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16f4546-f298-4dad-bd54-596c22433aae]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:44 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 Nov 05 16:12:44 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:44 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b" returned: 0 in 0.305s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d585306f-b224-461a-b4bd-86bb44cecda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b668aa87-164e-403e-b974-21a23efff04b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b19b388-bd9b-44f3-917e-576bc30faebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:44 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Volume volume-b668aa87-164e-403e-b974-21a23efff04b (b668aa87-164e-403e-b974-21a23efff04b): created successfully Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b19b388-bd9b-44f3-917e-576bc30faebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Flow 'volume_create_manager' (5201d080-394e-4561-84c7-5fbe3cd6fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:44 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0b36e8cf-c7a0-47b1-b3fd-a672c38527a1 tempest-VolumesMetadataTest-898250405 None] Created volume successfully. Nov 05 16:12:44 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828" returned: 0 in 0.379s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:44 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828 Nov 05 16:12:44 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:44 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28ae9c81-28c2-4da2-8af3-edd0544c7828" returned: 0 in 0.259s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Lock "cinder-quobyte-28ae9c81-28c2-4da2-8af3-edd0544c7828" released by "delete_volume" :: held 0.714s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Created reservations ['55bdd0cb-f7d2-4e5a-ac73-ba77a9ce9df5', '315d775d-781f-49af-b5e5-0cfe313abff2', 'b70200af-a4f8-4733-8008-23e8953374aa', 'a3862740-df87-4848-819a-4538ec026170'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:44 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:44 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:45 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.376s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:45 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Deleted volume successfully. Nov 05 16:12:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-9348dc22-5073-4b93-bad4-b60bc4159649 tempest-VolumesExtendTest-919785826 None] Lock "cinder-28ae9c81-28c2-4da2-8af3-edd0544c7828-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Acquiring lock "cinder-b668aa87-164e-403e-b974-21a23efff04b-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Lock "cinder-b668aa87-164e-403e-b974-21a23efff04b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Acquiring lock "cinder-quobyte-b668aa87-164e-403e-b974-21a23efff04b" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Lock "cinder-quobyte-b668aa87-164e-403e-b974-21a23efff04b" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[74176f70-1f73-44ba-b551-018eeee099b1]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:46 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b Nov 05 16:12:46 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:46 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:46 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b Nov 05 16:12:46 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:47 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b668aa87-164e-403e-b974-21a23efff04b" returned: 0 in 0.274s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Lock "cinder-quobyte-b668aa87-164e-403e-b974-21a23efff04b" released by "delete_volume" :: held 0.714s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Created reservations ['368d31c8-bce6-49ce-be6e-2e7dd1372cff', 'dccb9351-8e52-404f-b549-c2fbe599ca45', '2683ce7d-6d4b-4f6a-8814-1f86791428f5', '848e900c-6cf8-44a5-93e6-2cdd63f3b0cb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:47 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:47 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:47 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.314s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Deleted volume successfully. Nov 05 16:12:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac054437-1ebb-442f-abcb-d8c50773663d tempest-VolumesMetadataTest-898250405 None] Lock "cinder-b668aa87-164e-403e-b974-21a23efff04b-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "cinder-3bafee7a-a269-43ac-9069-ee64f6b7a014-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-3bafee7a-a269-43ac-9069-ee64f6b7a014-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "cinder-quobyte-3bafee7a-a269-43ac-9069-ee64f6b7a014" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-quobyte-3bafee7a-a269-43ac-9069-ee64f6b7a014" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4ef776-1fee-4ac9-800d-f3a8f7ffb967]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:48 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 Nov 05 16:12:48 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:48 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014" returned: 0 in 0.547s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:48 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014 Nov 05 16:12:48 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:49 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3bafee7a-a269-43ac-9069-ee64f6b7a014" returned: 0 in 0.314s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-quobyte-3bafee7a-a269-43ac-9069-ee64f6b7a014" released by "delete_volume" :: held 0.922s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Created reservations ['f59fb68c-088d-4dc8-8f71-f31c9a422688', '50b058e0-ab39-442d-9100-8194153ed2c3', '532b6871-718a-4835-a8f5-6210579e22a4', '93933192-66c6-44a1-a66c-c8db17690b38'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:49 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:49 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "cinder-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "cinder-quobyte-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-quobyte-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001e5bb-e91a-47d7-94f3-86d51f209449]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:49 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.450s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:49 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Deleted volume successfully. Nov 05 16:12:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8efa7c97-0325-4e01-bc91-6d8a7eb07f21 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-3bafee7a-a269-43ac-9069-ee64f6b7a014-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:49 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 Nov 05 16:12:49 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:50 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:50 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:50 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77" returned: 0 in 0.550s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:50 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77 Nov 05 16:12:50 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:50 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.507s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:12:50 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77" returned: 0 in 0.427s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-quobyte-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77" released by "delete_volume" :: held 1.068s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Created reservations ['c55d8b48-e638-4aff-bc18-2e8396051839', 'd5028fc9-7c78-4a1b-b2bb-778065a30907', '07a30332-8b3e-46fc-8cee-f1b02419e7e4', 'a2709990-6679-43ca-8955-09e9df3a7e97'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:51 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:51 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:51 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:51 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Deleted volume successfully. Nov 05 16:12:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2f11da65-4899-45f1-a9af-7a4adb5ef3ef tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-b7bc0697-0d0d-4c77-bfe6-b7ccde09aa77-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "cinder-16285b16-8c4b-4289-8ee6-6dfa02f39ed4-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-16285b16-8c4b-4289-8ee6-6dfa02f39ed4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "cinder-quobyte-16285b16-8c4b-4289-8ee6-6dfa02f39ed4" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-quobyte-16285b16-8c4b-4289-8ee6-6dfa02f39ed4" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b54170-8981-4405-b0dd-b2028ecf50f0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:52 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 Nov 05 16:12:52 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:52 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4" returned: 0 in 0.423s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:52 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4 Nov 05 16:12:52 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:52 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-16285b16-8c4b-4289-8ee6-6dfa02f39ed4" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-quobyte-16285b16-8c4b-4289-8ee6-6dfa02f39ed4" released by "delete_volume" :: held 0.757s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:52 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Created reservations ['0985ac38-0cf9-4cb7-b22e-7c53fb6c37ca', '13ebae0f-753b-4897-a243-ee3d775a8c79', '588c1b1d-5ce0-46ae-8c11-c49a247715b4', 'e24f51a0-d46d-418d-a4a4-96af361f9229'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:53 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:53 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Flow 'volume_create_manager' (2f0d2ba7-74ca-4821-a369-4f369790e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650b3440-9cfd-4c82-ad22-03cc53249df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650b3440-9cfd-4c82-ad22-03cc53249df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1608632041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03068c8-0441-4b70-a92d-a0bf9037e32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c05a2210c554e7c895e7df0832c975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:53Z,use_quota=True,user_id='a9a86bb9702d40aa8adc8557eca814f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd376d3-c436-484b-afec-f38731eac3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd376d3-c436-484b-afec-f38731eac3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1addb6f3-af8e-4d5a-a31f-c5f0c231555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1addb6f3-af8e-4d5a-a31f-c5f0c231555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03068c8-0441-4b70-a92d-a0bf9037e32c', 'volume_name': 'volume-d03068c8-0441-4b70-a92d-a0bf9037e32c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd49986-47bc-4cd4-8cc8-6134c9f31707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd49986-47bc-4cd4-8cc8-6134c9f31707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d0c70f-8557-4a20-b2cb-11de6beb48c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:53 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Volume d03068c8-0441-4b70-a92d-a0bf9037e32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03068c8-0441-4b70-a92d-a0bf9037e32c', 'volume_size': 1} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1608632041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03068c8-0441-4b70-a92d-a0bf9037e32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c05a2210c554e7c895e7df0832c975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:53Z,use_quota=True,user_id='a9a86bb9702d40aa8adc8557eca814f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Creating volume d03068c8-0441-4b70-a92d-a0bf9037e32c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:53 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:53 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:53 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c 1073741824 Nov 05 16:12:53 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:12:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Deleted volume successfully. Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-229390f7-0528-467e-b779-fbe8a27de2e0 tempest-AttachVolumeTestJSON-2058676164 None] Lock "cinder-16285b16-8c4b-4289-8ee6-6dfa02f39ed4-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:53 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c 1073741824" returned: 0 in 0.573s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:54 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c Nov 05 16:12:54 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:54 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c" returned: 0 in 0.336s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d0c70f-8557-4a20-b2cb-11de6beb48c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03068c8-0441-4b70-a92d-a0bf9037e32c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1ffb15-e213-460f-a3bd-a7b0dae52a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Volume volume-d03068c8-0441-4b70-a92d-a0bf9037e32c (d03068c8-0441-4b70-a92d-a0bf9037e32c): created successfully Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1ffb15-e213-460f-a3bd-a7b0dae52a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Flow 'volume_create_manager' (2f0d2ba7-74ca-4821-a369-4f369790e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-30c2ee66-4603-4d61-b034-f34968606219 tempest-AttachVolumeNegativeTest-129395497 None] Created volume successfully. Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Flow 'volume_create_manager' (d3f1f57e-c5c2-492c-8257-31507f61a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86232774-13e5-4bbb-9062-4b0954b05b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86232774-13e5-4bbb-9062-4b0954b05b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-365150148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df01d44b-fe0d-4001-8afe-ab013080c335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a1a259069e4c5784810d7807b5be5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:55Z,use_quota=True,user_id='949a302bc6ee44a7ab91d9890df59cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06038bc9-53df-4cf6-b621-de5fe8f7ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06038bc9-53df-4cf6-b621-de5fe8f7ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461628db-882d-4206-92e9-c98ed1bf436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461628db-882d-4206-92e9-c98ed1bf436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df01d44b-fe0d-4001-8afe-ab013080c335', 'volume_name': 'volume-df01d44b-fe0d-4001-8afe-ab013080c335', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4ea518-23dd-48d1-bac7-bea4a01be930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4ea518-23dd-48d1-bac7-bea4a01be930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db548f6-62cc-4001-b70b-258bfb0fe93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Volume df01d44b-fe0d-4001-8afe-ab013080c335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df01d44b-fe0d-4001-8afe-ab013080c335', 'volume_size': 1} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-365150148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df01d44b-fe0d-4001-8afe-ab013080c335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a1a259069e4c5784810d7807b5be5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:55Z,use_quota=True,user_id='949a302bc6ee44a7ab91d9890df59cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Creating volume df01d44b-fe0d-4001-8afe-ab013080c335 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:55 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:12:55 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 1073741824 Nov 05 16:12:55 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Flow 'volume_create_manager' (41e8fd58-b78a-4320-ab3e-34a8d7024612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2edace-14a8-4488-a323-f71c65c19e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2edace-14a8-4488-a323-f71c65c19e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-862862508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4a3724-1666-42f7-ba10-5f6a6c2f335c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc19e6b5d88646308ddb22bc78e3efa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:55Z,use_quota=True,user_id='47ca22ec13e9423aaed91d3292355b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94447535-7bae-4bac-a92f-87dea64c6ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94447535-7bae-4bac-a92f-87dea64c6ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5081c427-43cc-4392-a7d5-2b3d6d2bb2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5081c427-43cc-4392-a7d5-2b3d6d2bb2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4a3724-1666-42f7-ba10-5f6a6c2f335c', 'volume_name': 'volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdf7757-64da-4cbb-acfc-e9cf2d2c8a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdf7757-64da-4cbb-acfc-e9cf2d2c8a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bdafd9-bbb6-4cbc-b982-8a3792ff2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:55 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Volume 3a4a3724-1666-42f7-ba10-5f6a6c2f335c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c', 'volume_size': 1} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-91ce24a0-312a-4b6d-a999-0b4aaa206255 req-821e0076-f8ea-474f-b52c-a875f75be2d2 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:55 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 1073741824" returned: 0 in 0.647s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:55 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 Nov 05 16:12:55 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:55 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335" returned: 0 in 0.286s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-862862508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4a3724-1666-42f7-ba10-5f6a6c2f335c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc19e6b5d88646308ddb22bc78e3efa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:12:55Z,use_quota=True,user_id='47ca22ec13e9423aaed91d3292355b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Creating volume 3a4a3724-1666-42f7-ba10-5f6a6c2f335c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:12:55 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:12:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db548f6-62cc-4001-b70b-258bfb0fe93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df01d44b-fe0d-4001-8afe-ab013080c335', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:56 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c 1073741824 Nov 05 16:12:56 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2d0f3d-40c6-4730-8931-09e0244f1b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Volume volume-df01d44b-fe0d-4001-8afe-ab013080c335 (df01d44b-fe0d-4001-8afe-ab013080c335): created successfully Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2d0f3d-40c6-4730-8931-09e0244f1b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Flow 'volume_create_manager' (d3f1f57e-c5c2-492c-8257-31507f61a39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fe1a14eb-4bd4-4f7f-aa51-7e4949645669 tempest-VolumesTransfersTest-379483548 None] Created volume successfully. Nov 05 16:12:56 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c 1073741824" returned: 0 in 0.507s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:56 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c Nov 05 16:12:56 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:56 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-91ce24a0-312a-4b6d-a999-0b4aaa206255 req-821e0076-f8ea-474f-b52c-a875f75be2d2 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.269s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bdafd9-bbb6-4cbc-b982-8a3792ff2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690c1027-9a3c-4307-bbb1-a0dc2f33cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-91ce24a0-312a-4b6d-a999-0b4aaa206255 req-821e0076-f8ea-474f-b52c-a875f75be2d2 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Volume volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c (3a4a3724-1666-42f7-ba10-5f6a6c2f335c): created successfully Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690c1027-9a3c-4307-bbb1-a0dc2f33cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Flow 'volume_create_manager' (41e8fd58-b78a-4320-ab3e-34a8d7024612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:12:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-266a3c5a-f9f2-44c3-a1b5-7f969e4e2ced tempest-VolumesNegativeTest-101346128 None] Created volume successfully. Nov 05 16:12:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-91ce24a0-312a-4b6d-a999-0b4aaa206255 req-821e0076-f8ea-474f-b52c-a875f75be2d2 tempest-AttachVolumeNegativeTest-129395497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-d03068c8-0441-4b70-a92d-a0bf9037e32c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43b86c3e-55c7-40a9-9d60-c3db78c08993', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:12:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-91ce24a0-312a-4b6d-a999-0b4aaa206255 req-821e0076-f8ea-474f-b52c-a875f75be2d2 tempest-AttachVolumeNegativeTest-129395497 None] attachment_update completed successfully. Nov 05 16:12:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8ff3d806-da0d-42dd-83ca-d83303481503 tempest-VolumesTransfersTest-554475652 None] Transfer volume completed successfully. Nov 05 16:12:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Acquiring lock "cinder-df01d44b-fe0d-4001-8afe-ab013080c335-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-df01d44b-fe0d-4001-8afe-ab013080c335-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Acquiring lock "cinder-quobyte-df01d44b-fe0d-4001-8afe-ab013080c335" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:12:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-quobyte-df01d44b-fe0d-4001-8afe-ab013080c335" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:12:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6313cb11-00ad-49c5-ab8a-320dbb1ca323]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:12:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:58 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 Nov 05 16:12:58 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:59 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335" returned: 0 in 0.697s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:59 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335 Nov 05 16:12:59 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:59 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-df01d44b-fe0d-4001-8afe-ab013080c335" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-quobyte-df01d44b-fe0d-4001-8afe-ab013080c335" released by "delete_volume" :: held 1.141s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Created reservations ['c098095c-1298-41a9-9fa3-f8598112cd15', 'b28db8f2-5ae7-4a90-93a9-aa9245c5da25', 'b5285593-1728-4d6d-b0bb-3892e30bdfd4', '5c74b810-2685-42ba-845f-bfc485f478c7'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:12:59 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:12:59 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:12:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-45b0854e-c60e-49fc-a279-035a948720ac req-32acac35-cf36-4202-9bcd-e385e8c45f88 tempest-AttachVolumeNegativeTest-129395497 None] Terminate volume connection completed successfully. Nov 05 16:12:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-45b0854e-c60e-49fc-a279-035a948720ac req-32acac35-cf36-4202-9bcd-e385e8c45f88 tempest-AttachVolumeNegativeTest-129395497 None] Deleting attachment 43b86c3e-55c7-40a9-9d60-c3db78c08993. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:13:00 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.339s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:00 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:13:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Deleted volume successfully. Nov 05 16:13:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f35d68c3-541f-49b7-b1d5-668bed437c95 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-df01d44b-fe0d-4001-8afe-ab013080c335-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Flow 'volume_create_manager' (54a8aaf5-ad8f-4603-995f-a145b5e26f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdd078c-251c-4c63-9463-83dbfe9c7635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bdd078c-251c-4c63-9463-83dbfe9c7635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1549150240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e4f62a-ec9c-428e-8f50-0c09463e6072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a1a259069e4c5784810d7807b5be5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:02Z,use_quota=True,user_id='949a302bc6ee44a7ab91d9890df59cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cee733-97ab-47a7-907f-5d2b4375e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cee733-97ab-47a7-907f-5d2b4375e26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a2cf2b-a895-464f-8439-8016cee913f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a2cf2b-a895-464f-8439-8016cee913f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e4f62a-ec9c-428e-8f50-0c09463e6072', 'volume_name': 'volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b324b35e-9151-4c6a-b036-1d6563dde0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b324b35e-9151-4c6a-b036-1d6563dde0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386f4ae7-8050-4067-bf91-9141a9e67f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:02 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Volume c0e4f62a-ec9c-428e-8f50-0c09463e6072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072', 'volume_size': 1} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1549150240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e4f62a-ec9c-428e-8f50-0c09463e6072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a1a259069e4c5784810d7807b5be5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:02Z,use_quota=True,user_id='949a302bc6ee44a7ab91d9890df59cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Creating volume c0e4f62a-ec9c-428e-8f50-0c09463e6072 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:13:02 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:02 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 1073741824 Nov 05 16:13:02 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:02 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 1073741824" returned: 0 in 0.654s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:02 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 Nov 05 16:13:02 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:03 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072" returned: 0 in 0.263s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:13:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386f4ae7-8050-4067-bf91-9141a9e67f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799e8ce5-eb3f-4773-8673-664aed25faf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:03 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Volume volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 (c0e4f62a-ec9c-428e-8f50-0c09463e6072): created successfully Nov 05 16:13:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799e8ce5-eb3f-4773-8673-664aed25faf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Flow 'volume_create_manager' (54a8aaf5-ad8f-4603-995f-a145b5e26f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:03 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-50b567df-7171-4be1-98bb-f0304a4a214a tempest-VolumesTransfersTest-379483548 None] Created volume successfully. Nov 05 16:13:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Acquiring lock "cinder-c0e4f62a-ec9c-428e-8f50-0c09463e6072-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-c0e4f62a-ec9c-428e-8f50-0c09463e6072-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Acquiring lock "cinder-quobyte-c0e4f62a-ec9c-428e-8f50-0c09463e6072" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-quobyte-c0e4f62a-ec9c-428e-8f50-0c09463e6072" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:04 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[556d899d-aa13-4d65-95e5-aa62fc1923ce]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:04 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 Nov 05 16:13:04 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:04 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5a39cc13-8d82-45bf-b7d3-472d2d5c3a14 tempest-GroupsV320Test-448034623 None] Group tempest-GroupsV320Test-Group-360142866: creating Nov 05 16:13:04 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5a39cc13-8d82-45bf-b7d3-472d2d5c3a14 tempest-GroupsV320Test-448034623 None] Group tempest-GroupsV320Test-Group-360142866: created successfully Nov 05 16:13:04 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5a39cc13-8d82-45bf-b7d3-472d2d5c3a14 tempest-GroupsV320Test-448034623 None] Create group completed successfully. Nov 05 16:13:05 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072" returned: 0 in 0.417s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:05 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072 Nov 05 16:13:05 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:05 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c0e4f62a-ec9c-428e-8f50-0c09463e6072" returned: 0 in 0.290s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-quobyte-c0e4f62a-ec9c-428e-8f50-0c09463e6072" released by "delete_volume" :: held 0.771s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Created reservations ['87a09a5b-4a67-4fae-be1d-4c69c5cdc244', '25575b9d-b7bf-443c-832d-272e186e6bd7', '8e89beb2-2000-49e5-a876-2807d7deec10', '1db3d58e-4a1f-4d59-9f1c-9908fb1b0efc'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:05 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:13:05 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:06 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.544s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:06 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:13:06 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Deleted volume successfully. Nov 05 16:13:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-307b40c7-953b-42ed-a5b5-b502a96ec1e0 tempest-VolumesTransfersTest-974422008 None] Lock "cinder-c0e4f62a-ec9c-428e-8f50-0c09463e6072-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Created reservations ['674699a3-7e1e-4a28-b65d-c77b3676ee5a'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:07 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:13:07 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:07 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.466s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:07 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:13:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c590b73e-486d-41ed-b957-37f8e3d7b164 tempest-GroupsV320Test-448034623 None] Delete group completed successfully. Nov 05 16:13:17 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=133,cinder:UPDATE=135,cinder:DELETE=10,cinder:INSERT=37 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:13:17 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=126,cinder:INSERT=37,cinder:UPDATE=142,cinder:DELETE=12 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Flow 'volume_create_manager' (873f21b0-804a-4da9-bbca-436bc3622bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a23ea0-8661-4030-9928-1d9f3dd43112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a23ea0-8661-4030-9928-1d9f3dd43112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-969486415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234bb65e-d7f6-445d-a982-4c58ebb41705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e75dbecaf6d459eb920fd11018b877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:18Z,use_quota=True,user_id='7ab989e5d27040dc90a3a91f42c5a107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538eddf2-240a-41fd-80a5-c74a74098650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538eddf2-240a-41fd-80a5-c74a74098650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee0c8e8-d007-44b3-8227-0eb41760666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee0c8e8-d007-44b3-8227-0eb41760666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234bb65e-d7f6-445d-a982-4c58ebb41705', 'volume_name': 'volume-234bb65e-d7f6-445d-a982-4c58ebb41705', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074ea3f3-b91a-4ade-9fca-86a892b78f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074ea3f3-b91a-4ade-9fca-86a892b78f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f91fd-812b-44b9-8d07-2a6be15c6f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Volume 234bb65e-d7f6-445d-a982-4c58ebb41705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234bb65e-d7f6-445d-a982-4c58ebb41705', 'volume_size': 1} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-969486415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234bb65e-d7f6-445d-a982-4c58ebb41705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e75dbecaf6d459eb920fd11018b877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:18Z,use_quota=True,user_id='7ab989e5d27040dc90a3a91f42c5a107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Creating volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:13:18 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:13:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:18 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 1073741824 Nov 05 16:13:18 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:19 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 1073741824" returned: 0 in 1.058s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:19 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 Nov 05 16:13:19 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:19 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705" returned: 0 in 0.378s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:13:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f91fd-812b-44b9-8d07-2a6be15c6f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234bb65e-d7f6-445d-a982-4c58ebb41705', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b17d06-04d3-45a6-9cf6-518be5e3e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Volume volume-234bb65e-d7f6-445d-a982-4c58ebb41705 (234bb65e-d7f6-445d-a982-4c58ebb41705): created successfully Nov 05 16:13:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b17d06-04d3-45a6-9cf6-518be5e3e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Flow 'volume_create_manager' (873f21b0-804a-4da9-bbca-436bc3622bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:20 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-761532f1-8ed9-4e73-b0fe-187b468cb0d2 tempest-SnapshotsActionsTest-1870586508 None] Created volume successfully. Nov 05 16:13:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Creating offline snapshot a446e01b-1678-4ca6-96b4-5d5e8a1f96dc of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:21 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec69a63-ef11-4210-b6af-05d83683eebb]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:21 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 Nov 05 16:13:21 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:21 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705" returned: 0 in 0.562s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:21 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc 1G Nov 05 16:13:21 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:22 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc 1G" returned: 0 in 0.937s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:22 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:22 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:23 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.482s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:23 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc is being set with open permissions: ugo+rw Nov 05 16:13:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:23 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:23 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:23 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.531s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:23 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.info Nov 05 16:13:23 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:24 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.info" returned: 0 in 0.624s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:24 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.info is being set with open permissions: ugo+rw Nov 05 16:13:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:24 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.info Nov 05 16:13:24 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:24 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.info" returned: 0 in 0.623s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.940s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:24 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-31d79dc3-2ffb-482f-af9e-cd38c176dd8a tempest-SnapshotsActionsTest-1870586508 None] Create snapshot completed successfully Nov 05 16:13:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Acquiring lock "cinder-3a4a3724-1666-42f7-ba10-5f6a6c2f335c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Lock "cinder-3a4a3724-1666-42f7-ba10-5f6a6c2f335c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Acquiring lock "cinder-quobyte-3a4a3724-1666-42f7-ba10-5f6a6c2f335c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Lock "cinder-quobyte-3a4a3724-1666-42f7-ba10-5f6a6c2f335c" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3d77cc-a535-41d7-aa13-b8cb0b92b88a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:26 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c Nov 05 16:13:26 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Creating offline snapshot f6b89148-d4af-42e1-abc4-b2fe4511758c of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f937ad6-97ad-4dfe-b5ef-c86b385c6b47]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:26 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:26 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:26 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c" returned: 0 in 0.821s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:26 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c Nov 05 16:13:26 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:27 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.645s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:27 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c 1G Nov 05 16:13:27 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:27 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a4a3724-1666-42f7-ba10-5f6a6c2f335c" returned: 0 in 0.393s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Lock "cinder-quobyte-3a4a3724-1666-42f7-ba10-5f6a6c2f335c" released by "delete_volume" :: held 1.321s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Created reservations ['fe11c804-81dd-4555-ad2a-a3404b0feb65', '50dce3a8-d4a7-4ea9-acae-98679ef32854', '0225b0a0-db5c-4867-a0cf-c346f0c31c04', '0a25456b-69f4-4150-93b0-91ea55e0656e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:27 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:13:27 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:27 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c 1G" returned: 0 in 0.764s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:27 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c Nov 05 16:13:27 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:27 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:27 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:13:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Deleted volume successfully. Nov 05 16:13:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58e701d3-6c66-44bb-bb73-718a9679f3f2 tempest-VolumesNegativeTest-101346128 None] Lock "cinder-3a4a3724-1666-42f7-ba10-5f6a6c2f335c-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:28 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c" returned: 0 in 0.576s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:28 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c is being set with open permissions: ugo+rw Nov 05 16:13:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:28 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c Nov 05 16:13:28 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:28 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c" returned: 0 in 0.363s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e9b024e1-515b-4253-8698-759f4d2a5fa7 tempest-SnapshotsActionsTest-1870586508 None] Create snapshot completed successfully Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-f6b89148-d4af-42e1-abc4-b2fe4511758c-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-f6b89148-d4af-42e1-abc4-b2fe4511758c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-f6b89148-d4af-42e1-abc4-b2fe4511758c" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-f6b89148-d4af-42e1-abc4-b2fe4511758c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Deleting offline snapshot f6b89148-d4af-42e1-abc4-b2fe4511758c of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] snapshot_file for this snap is: volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[328473ed-4c1b-4fae-bd08-56f9a225ce2d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:30 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c Nov 05 16:13:30 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:30 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c" returned: 0 in 0.596s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:30 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee1fb7-53ca-4150-8059-cc7151cc3b63]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:30 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:30 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:30 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.458s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:31 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c Nov 05 16:13:31 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:31 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c" returned: 0 in 0.518s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:31 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c Nov 05 16:13:31 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:31 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.f6b89148-d4af-42e1-abc4-b2fe4511758c" returned: 0 in 0.465s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-f6b89148-d4af-42e1-abc4-b2fe4511758c" released by "_delete_snapshot" :: held 2.207s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" released by "delete_snapshot" :: held 2.261s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Flow 'volume_create_manager' (6115a2ea-38e0-474c-9848-82717adecce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e99a35-37c8-4714-9df1-12a934e179bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e99a35-37c8-4714-9df1-12a934e179bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-161263876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbfa4737-d46b-474d-ac39-3db876eceac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0fd69aab13420aadab2f1e6be63614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:32Z,use_quota=True,user_id='d0d8d23424e544a7af7df913c0f06861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4b7e74-a3c9-47bb-9eea-96aa3480dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4b7e74-a3c9-47bb-9eea-96aa3480dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a37ac18-5baa-4c19-9b56-f5d4c1df1320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a37ac18-5baa-4c19-9b56-f5d4c1df1320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbfa4737-d46b-474d-ac39-3db876eceac8', 'volume_name': 'volume-dbfa4737-d46b-474d-ac39-3db876eceac8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9118ccb8-cb1d-4dd4-9249-6ebb51756989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9118ccb8-cb1d-4dd4-9249-6ebb51756989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a392cf6-33f7-4d30-bf61-8e4d2f32c0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:32 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Volume dbfa4737-d46b-474d-ac39-3db876eceac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbfa4737-d46b-474d-ac39-3db876eceac8', 'volume_size': 1} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-161263876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbfa4737-d46b-474d-ac39-3db876eceac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0fd69aab13420aadab2f1e6be63614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:32Z,use_quota=True,user_id='d0d8d23424e544a7af7df913c0f06861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Creating volume dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:13:32 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:32 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 1073741824 Nov 05 16:13:32 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Created reservations ['2f51641e-add7-4494-a405-a9eecfa1a83b', '0bb921db-d824-408c-b6f6-38a7030fc239', 'd226e1ec-b408-477d-9956-1bb70e3fc9cd', 'b3d4542e-aab8-4f1d-bb1d-4001983551d5'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Delete snapshot completed successfully. Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72d4054c-d85e-45fe-965a-528ab054a91c tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-f6b89148-d4af-42e1-abc4-b2fe4511758c-delete_snapshot" released by "delete_snapshot" :: held 2.578s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:32 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 1073741824" returned: 0 in 0.581s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:32 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:13:32 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:33 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.328s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a392cf6-33f7-4d30-bf61-8e4d2f32c0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbfa4737-d46b-474d-ac39-3db876eceac8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1605c8-b6f1-4153-a40f-5e3e4715daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Volume volume-dbfa4737-d46b-474d-ac39-3db876eceac8 (dbfa4737-d46b-474d-ac39-3db876eceac8): created successfully Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1605c8-b6f1-4153-a40f-5e3e4715daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Flow 'volume_create_manager' (6115a2ea-38e0-474c-9848-82717adecce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1f6a6f9a-ce9b-4cf4-8418-889ac0228c45 tempest-VolumesActionsTest-1161214895 None] Created volume successfully. Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Flow 'volume_create_manager' (fb615a0f-37ea-45ee-a1ad-568aafa444de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e18b5de-74a3-4ee0-9353-9ac874d73ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e18b5de-74a3-4ee0-9353-9ac874d73ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-200668479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a52f40-e66c-457a-90f5-25b6b86aba4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7404695a998410e9b25cb0cb1747d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:33Z,use_quota=True,user_id='6887b5a082a4458582b1032aad3da681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c9aae5-7478-49f8-ad71-7414c5cbc710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c9aae5-7478-49f8-ad71-7414c5cbc710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b8e30b-4f6c-4836-bc5e-3448591cd5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b8e30b-4f6c-4836-bc5e-3448591cd5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7a52f40-e66c-457a-90f5-25b6b86aba4b', 'volume_name': 'volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a1a977-c048-44b0-9f4b-6bbbfb6b3a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a1a977-c048-44b0-9f4b-6bbbfb6b3a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73baa5c-9c80-4cd8-bdd3-c2957723b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Volume a7a52f40-e66c-457a-90f5-25b6b86aba4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b', 'volume_size': 1} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-200668479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a52f40-e66c-457a-90f5-25b6b86aba4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7404695a998410e9b25cb0cb1747d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:33Z,use_quota=True,user_id='6887b5a082a4458582b1032aad3da681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Creating volume a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:13:33 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:33 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b 1073741824 Nov 05 16:13:33 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:33 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b 1073741824" returned: 0 in 0.447s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:34 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b Nov 05 16:13:34 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:34 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b" returned: 0 in 0.279s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.748s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73baa5c-9c80-4cd8-bdd3-c2957723b11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423d200a-c36c-4b63-9f07-08fb517e64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Creating offline snapshot 43d000de-0cbd-4933-87df-3c1b215712ba of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:34 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Volume volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b (a7a52f40-e66c-457a-90f5-25b6b86aba4b): created successfully Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423d200a-c36c-4b63-9f07-08fb517e64ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Flow 'volume_create_manager' (fb615a0f-37ea-45ee-a1ad-568aafa444de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8683e4b1-63fe-4da6-b05c-463a2e53281c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:34 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-aed088ff-9210-43fa-b234-8733ffdb472d tempest-VolumesSnapshotListTestJSON-1138788973 None] Created volume successfully. Nov 05 16:13:34 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:34 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:34 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.358s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:34 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba 1G Nov 05 16:13:34 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:35 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba 1G" returned: 0 in 0.470s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:35 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba Nov 05 16:13:35 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:35 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba" returned: 0 in 0.333s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:35 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba is being set with open permissions: ugo+rw Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:35 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba Nov 05 16:13:35 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:35 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba" returned: 0 in 0.257s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.567s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.153s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Creating offline snapshot 467c08ae-a867-49cd-9678-1aef239ac2c8 of volume a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-37d8d986-6d59-4e5e-aa8d-9e83aaa2a2a2 tempest-SnapshotsActionsTest-1870586508 None] Create snapshot completed successfully Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9472adfa-7d3a-41b3-8b06-f84e0fafaff8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:36 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b Nov 05 16:13:36 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:36 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b" returned: 0 in 0.451s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:36 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 1G Nov 05 16:13:36 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-43d000de-0cbd-4933-87df-3c1b215712ba-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-43d000de-0cbd-4933-87df-3c1b215712ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-43d000de-0cbd-4933-87df-3c1b215712ba" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-43d000de-0cbd-4933-87df-3c1b215712ba" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Deleting offline snapshot 43d000de-0cbd-4933-87df-3c1b215712ba of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] snapshot_file for this snap is: volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[916879e2-afd9-4c45-ab12-20c2e937599c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:36 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 1G" returned: 0 in 0.562s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:36 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 Nov 05 16:13:36 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:37 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba Nov 05 16:13:37 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:37 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8" returned: 0 in 0.342s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:37 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 is being set with open permissions: ugo+rw Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:37 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 Nov 05 16:13:37 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:37 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba" returned: 0 in 0.432s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[411a804c-2cab-45bf-b118-6a1b617c88df]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:37 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:37 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:37 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8" returned: 0 in 0.283s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:37 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.info Nov 05 16:13:37 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:37 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:37 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba Nov 05 16:13:37 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:37 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.info" returned: 0 in 0.312s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:37 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.info is being set with open permissions: ugo+rw Nov 05 16:13:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:37 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.info Nov 05 16:13:37 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:38 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:38 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba" returned: 0 in 0.410s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.info" returned: 0 in 0.297s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:38 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba Nov 05 16:13:38 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7b106474-60d9-41a5-9fee-725b3d5497b0 tempest-VolumesSnapshotListTestJSON-1138788973 None] Create snapshot completed successfully Nov 05 16:13:38 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.43d000de-0cbd-4933-87df-3c1b215712ba" returned: 0 in 0.261s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-43d000de-0cbd-4933-87df-3c1b215712ba" released by "_delete_snapshot" :: held 1.655s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" released by "delete_snapshot" :: held 1.691s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Created reservations ['f6d8c1f5-6d18-475b-aba9-2b50bf57f954', '9af16eeb-b79f-4f39-8f69-ee1928779df9', 'a1cf8dfe-0992-4cb8-a247-329c9b46764d', '9a2a1151-0db2-4d2a-9d31-0d508afc0453'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Delete snapshot completed successfully. Nov 05 16:13:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c747001f-46fe-4ea9-bd8e-df4ca9041e6e tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-43d000de-0cbd-4933-87df-3c1b215712ba-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Creating offline snapshot f115876c-d028-43fb-9381-04b9453ea192 of volume a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:39 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51b5855-3627-4c8b-8692-75d6ea4e0b36]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:39 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 Nov 05 16:13:39 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:40 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8" returned: 0 in 0.747s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:40 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 1G Nov 05 16:13:40 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 1G" returned: 0 in 0.584s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:40 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:40 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 Nov 05 16:13:40 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:41 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192" returned: 0 in 0.324s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:41 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 is being set with open permissions: ugo+rw Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:41 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 Nov 05 16:13:41 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:41 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192" returned: 0 in 0.318s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.664s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Creating offline snapshot b4d56977-ba88-44d2-a4b7-804dac80b5dc of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8a3f13ce-fdb0-4210-b3d1-23dcff479e48 tempest-VolumesSnapshotListTestJSON-1138788973 None] Create snapshot completed successfully Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8a091f-388d-4226-987b-9d4ef7139901]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-efb77622-629a-4982-bebe-7534d1611cc3 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8" by "attach_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-efb77622-629a-4982-bebe-7534d1611cc3 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8" acquired by "attach_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:41 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:41 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-efb77622-629a-4982-bebe-7534d1611cc3 tempest-VolumesActionsTest-1161214895 None] Attaching volume dbfa4737-d46b-474d-ac39-3db876eceac8 to instance 5e4a60fe-abb2-4825-9f70-24774becc48a at mountpoint /dev/vdb on host None. Nov 05 16:13:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-efb77622-629a-4982-bebe-7534d1611cc3 tempest-VolumesActionsTest-1161214895 None] Attach volume completed successfully. Nov 05 16:13:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-efb77622-629a-4982-bebe-7534d1611cc3 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8" released by "attach_volume" :: held 0.125s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7e7271d7-7dfe-4030-b3d3-cada952e7bf5 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-detach_volume" by "detach_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7e7271d7-7dfe-4030-b3d3-cada952e7bf5 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7e7271d7-7dfe-4030-b3d3-cada952e7bf5 tempest-VolumesActionsTest-1161214895 None] Detaching volume dbfa4737-d46b-474d-ac39-3db876eceac8 from instance 5e4a60fe-abb2-4825-9f70-24774becc48a. Nov 05 16:13:42 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.433s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:42 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc 1G Nov 05 16:13:42 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7e7271d7-7dfe-4030-b3d3-cada952e7bf5 tempest-VolumesActionsTest-1161214895 None] Detach volume completed successfully. Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7e7271d7-7dfe-4030-b3d3-cada952e7bf5 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:42 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc 1G" returned: 0 in 0.553s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:42 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc Nov 05 16:13:42 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:43 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc" returned: 0 in 0.395s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:43 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc is being set with open permissions: ugo+rw Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:43 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc Nov 05 16:13:43 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:43 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.565s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Creating offline snapshot 58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 of volume a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db09745-1f9e-4958-b0a0-258f26c54b17]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-43e3faaa-5d8c-4336-80fe-b2f99cefe327 tempest-SnapshotsActionsTest-1870586508 None] Create snapshot completed successfully Nov 05 16:13:43 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 Nov 05 16:13:43 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:43 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192" returned: 0 in 0.428s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:43 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 1G Nov 05 16:13:43 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-b4d56977-ba88-44d2-a4b7-804dac80b5dc-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-b4d56977-ba88-44d2-a4b7-804dac80b5dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-b4d56977-ba88-44d2-a4b7-804dac80b5dc" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-b4d56977-ba88-44d2-a4b7-804dac80b5dc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Deleting offline snapshot b4d56977-ba88-44d2-a4b7-804dac80b5dc of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] snapshot_file for this snap is: volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c205af-0b12-41d1-b1b4-33f2fe46f404]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:44 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 1G" returned: 0 in 0.550s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:44 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc Nov 05 16:13:44 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:44 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 Nov 05 16:13:44 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:44 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc" returned: 0 in 0.401s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:44 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" returned: 0 in 0.315s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:44 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 is being set with open permissions: ugo+rw Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6df223-8c76-4bb4-9fb8-52e5e576ee9d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:44 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 Nov 05 16:13:44 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:44 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:44 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:45 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" returned: 0 in 0.273s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.774s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e99d6320-82ad-4a7a-b75b-88d6ac25f54d tempest-VolumesSnapshotListTestJSON-1138788973 None] Create snapshot completed successfully Nov 05 16:13:45 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.451s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:45 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc Nov 05 16:13:45 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Flow 'volume_create_manager' (272970d9-4639-4ef3-842a-795609951967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d4886e-c63b-4070-a433-31fb1ae2a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d4886e-c63b-4070-a433-31fb1ae2a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1168202390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9d989e-7d4e-494e-aeee-899f4cef2db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c05a2210c554e7c895e7df0832c975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:45Z,use_quota=True,user_id='a9a86bb9702d40aa8adc8557eca814f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e838581-5447-4431-abd7-46282cedaecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e838581-5447-4431-abd7-46282cedaecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d07083-a956-42f7-b665-8023e1a8efd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d07083-a956-42f7-b665-8023e1a8efd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9d989e-7d4e-494e-aeee-899f4cef2db4', 'volume_name': 'volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d806e1-f6f1-46f3-9e22-8fcb53552846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d806e1-f6f1-46f3-9e22-8fcb53552846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c5f6b2-7d6e-4ba5-b03a-c27aa4759664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:45 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Volume 5d9d989e-7d4e-494e-aeee-899f4cef2db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4', 'volume_size': 1} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1168202390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9d989e-7d4e-494e-aeee-899f4cef2db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c05a2210c554e7c895e7df0832c975b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:13:45Z,use_quota=True,user_id='a9a86bb9702d40aa8adc8557eca814f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Creating volume 5d9d989e-7d4e-494e-aeee-899f4cef2db4 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:13:45 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:45 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 1073741824 Nov 05 16:13:45 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:45 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc" returned: 0 in 0.429s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:45 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc Nov 05 16:13:45 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:46 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.b4d56977-ba88-44d2-a4b7-804dac80b5dc" returned: 0 in 0.308s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:46 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 1073741824" returned: 0 in 0.552s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-b4d56977-ba88-44d2-a4b7-804dac80b5dc" released by "_delete_snapshot" :: held 1.704s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" released by "delete_snapshot" :: held 1.734s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:46 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 Nov 05 16:13:46 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Created reservations ['c1b9676c-023c-45d9-9daf-68e5a3d2e434', 'a5cd63fd-5842-4b7d-9817-0595bb14a09f', '78b506c1-892c-453f-93b1-c48fd7f29684', 'ac9c909b-acd3-4f83-9e47-978912f8d617'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Delete snapshot completed successfully. Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-33d8ad69-9aad-47cb-b311-7f7fd42f5ec1 tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-b4d56977-ba88-44d2-a4b7-804dac80b5dc-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:46 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4" returned: 0 in 0.390s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c5f6b2-7d6e-4ba5-b03a-c27aa4759664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a67bd3-533b-45ec-a602-60601159f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:13:46 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Volume volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 (5d9d989e-7d4e-494e-aeee-899f4cef2db4): created successfully Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a67bd3-533b-45ec-a602-60601159f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Flow 'volume_create_manager' (272970d9-4639-4ef3-842a-795609951967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:13:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ae863017-b0d7-4e1d-b225-1c3fe2684156 tempest-AttachVolumeNegativeTest-129395497 None] Created volume successfully. Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Creating offline snapshot 58431461-ceb5-4c0a-b5b1-1779166584c3 of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b70434-9cc5-4d1e-86ba-6f764b5cd0a5]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-58908cc3-cfe5-4f23-b80e-b0f8f282ffe6-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-58908cc3-cfe5-4f23-b80e-b0f8f282ffe6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-quobyte-58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Deleting offline snapshot 58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 of volume a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] snapshot_file for this snap is: volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:47 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:47 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a12d7f-f7d2-4ccb-8d97-b72368054ea1]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:47 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 Nov 05 16:13:47 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:47 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.474s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:47 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 1G Nov 05 16:13:47 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:47 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" returned: 0 in 0.524s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eea7ac-56c9-4c11-b812-e24e30a5a737]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:47 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 Nov 05 16:13:47 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:48 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 1G" returned: 0 in 0.647s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:48 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 Nov 05 16:13:48 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:48 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192" returned: 0 in 0.623s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:48 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 Nov 05 16:13:48 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-b51fd6f6-1075-4cc9-a043-b487866d6f09 req-6c7fd169-ea66-490b-b127-742efbadfb7a tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:48 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3" returned: 0 in 0.674s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:48 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 is being set with open permissions: ugo+rw Nov 05 16:13:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:48 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 Nov 05 16:13:48 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:49 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" returned: 0 in 0.707s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:49 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:49 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6 Nov 05 16:13:49 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-b51fd6f6-1075-4cc9-a043-b487866d6f09 req-6c7fd169-ea66-490b-b127-742efbadfb7a tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.403s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-b51fd6f6-1075-4cc9-a043-b487866d6f09 req-6c7fd169-ea66-490b-b127-742efbadfb7a tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:49 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0ffef378-c419-41aa-9859-74ef99c4922a tempest-SnapshotsActionsTest-1870586508 None] Create snapshot completed successfully Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-b51fd6f6-1075-4cc9-a043-b487866d6f09 req-6c7fd169-ea66-490b-b127-742efbadfb7a tempest-AttachVolumeNegativeTest-129395497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '631bb027-1460-4ff5-a1c7-e940f438af1a', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:13:49 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-b51fd6f6-1075-4cc9-a043-b487866d6f09 req-6c7fd169-ea66-490b-b127-742efbadfb7a tempest-AttachVolumeNegativeTest-129395497 None] attachment_update completed successfully. Nov 05 16:13:49 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" returned: 0 in 0.325s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-58908cc3-cfe5-4f23-b80e-b0f8f282ffe6" released by "_delete_snapshot" :: held 2.341s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" released by "delete_snapshot" :: held 2.380s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Created reservations ['51c7325b-90d7-4c8d-8351-8fa50081508b', '8c762c43-efff-40d7-b121-e99d7a44e860', '90071226-1943-4681-b494-885f7d26a08d', '4b5e677a-200e-4f62-aaf1-07934023d783'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:49 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Delete snapshot completed successfully. Nov 05 16:13:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3c3068a0-90a5-463d-9f09-d34bee25e312 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-58908cc3-cfe5-4f23-b80e-b0f8f282ffe6-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-58431461-ceb5-4c0a-b5b1-1779166584c3-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:50 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:13:50 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-58431461-ceb5-4c0a-b5b1-1779166584c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Acquiring lock "cinder-quobyte-58431461-ceb5-4c0a-b5b1-1779166584c3" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-f115876c-d028-43fb-9381-04b9453ea192-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-58431461-ceb5-4c0a-b5b1-1779166584c3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Deleting offline snapshot 58431461-ceb5-4c0a-b5b1-1779166584c3 of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] snapshot_file for this snap is: volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-f115876c-d028-43fb-9381-04b9453ea192-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa34b1f-dadc-4110-82a2-0df9551fd51e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-quobyte-f115876c-d028-43fb-9381-04b9453ea192" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-f115876c-d028-43fb-9381-04b9453ea192" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Deleting offline snapshot f115876c-d028-43fb-9381-04b9453ea192 of volume a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] snapshot_file for this snap is: volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faacabb-f358-44ac-b3d8-18cf4dd6dd10]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:50 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 Nov 05 16:13:50 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:50 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.413s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:13:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:13:50 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 Nov 05 16:13:50 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:51 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3" returned: 0 in 0.872s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:51 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192" returned: 0 in 0.786s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7071769-9bf6-494d-93c8-599f0a76a475]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d849cfd-dcd1-49b3-8360-fe90d4a5d500]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:51 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:51 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:51 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 Nov 05 16:13:51 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:52 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.908s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:52 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8" returned: 0 in 0.901s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:52 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 Nov 05 16:13:52 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:52 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 Nov 05 16:13:52 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:52 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-0f2c6cf5-1f45-4c1b-94bf-59de2a509c02 req-0b068bac-34b1-4d11-b401-dd615b56af4e tempest-AttachVolumeNegativeTest-129395497 None] Terminate volume connection completed successfully. Nov 05 16:13:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-0f2c6cf5-1f45-4c1b-94bf-59de2a509c02 req-0b068bac-34b1-4d11-b401-dd615b56af4e tempest-AttachVolumeNegativeTest-129395497 None] Deleting attachment 631bb027-1460-4ff5-a1c7-e940f438af1a. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:13:53 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3" returned: 0 in 0.807s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:53 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192" returned: 0 in 0.788s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:53 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3 Nov 05 16:13:53 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:53 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192 Nov 05 16:13:53 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:53 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.f115876c-d028-43fb-9381-04b9453ea192" returned: 0 in 0.318s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-f115876c-d028-43fb-9381-04b9453ea192" released by "_delete_snapshot" :: held 3.033s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" released by "delete_snapshot" :: held 3.075s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:53 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.58431461-ceb5-4c0a-b5b1-1779166584c3" returned: 0 in 0.463s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-58431461-ceb5-4c0a-b5b1-1779166584c3" released by "_delete_snapshot" :: held 3.269s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" released by "delete_snapshot" :: held 3.302s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Created reservations ['54fe4e52-5b0e-47ad-9854-4f830e275994', 'b3102712-abda-452e-a947-df9222905ab4', '21b65242-2736-4387-bc86-8add6ca14262', '1d728928-3d8d-431c-aad3-a62873fbf439'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Delete snapshot completed successfully. Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2ce6246c-1b48-42fc-a043-b0ecc7a87cee tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-f115876c-d028-43fb-9381-04b9453ea192-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Created reservations ['43e4a70b-e699-4099-9fe8-3b23db4d10fb', 'ee291e54-8c4d-42f1-b4fe-48af38ffd44e', '3449d752-bf1c-4dea-be7d-2323d2fafd6e', '83255092-404d-4e0e-bc21-a23d311873a0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Delete snapshot completed successfully. Nov 05 16:13:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff80943d-e8e9-489f-86dc-c9363713f2cc tempest-SnapshotsActionsTest-533438750 None] Lock "cinder-58431461-ceb5-4c0a-b5b1-1779166584c3-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-467c08ae-a867-49cd-9678-1aef239ac2c8-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-467c08ae-a867-49cd-9678-1aef239ac2c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-quobyte-467c08ae-a867-49cd-9678-1aef239ac2c8" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-467c08ae-a867-49cd-9678-1aef239ac2c8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Deleting offline snapshot 467c08ae-a867-49cd-9678-1aef239ac2c8 of volume a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] snapshot_file for this snap is: volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb4c31-b2b9-4836-958e-0cf3eb173669]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab03789-4bb7-40e3-a18d-c4e1e2b77bc3 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8" by "attach_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:55 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 Nov 05 16:13:55 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab03789-4bb7-40e3-a18d-c4e1e2b77bc3 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8" acquired by "attach_volume" :: waited 0.057s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6ab03789-4bb7-40e3-a18d-c4e1e2b77bc3 tempest-VolumesActionsTest-1161214895 None] Attaching volume dbfa4737-d46b-474d-ac39-3db876eceac8 to instance 5cdd0310-9425-45c3-afd8-a9be3fcf9e8e at mountpoint /dev/vdb on host None. Nov 05 16:13:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6ab03789-4bb7-40e3-a18d-c4e1e2b77bc3 tempest-VolumesActionsTest-1161214895 None] Attach volume completed successfully. Nov 05 16:13:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ab03789-4bb7-40e3-a18d-c4e1e2b77bc3 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8" released by "attach_volume" :: held 0.272s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "cinder-a446e01b-1678-4ca6-96b4-5d5e8a1f96dc-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:56 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8" returned: 0 in 1.070s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-a446e01b-1678-4ca6-96b4-5d5e8a1f96dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.150s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "cinder-quobyte-a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c8c05-778f-457c-92bf-67eb1c6ab046]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-quobyte-a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Deleting offline snapshot a446e01b-1678-4ca6-96b4-5d5e8a1f96dc of volume 234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] snapshot_file for this snap is: volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d4ead-e0b3-4ff2-82a8-a473702ff936]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8487531a-29c4-4f03-a3a7-f66e6885ee1b tempest-VolumesActionsTest-1161214895 None] Acquiring lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-detach_volume" by "detach_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8487531a-29c4-4f03-a3a7-f66e6885ee1b tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-detach_volume" acquired by "detach_volume" :: waited 0.063s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8487531a-29c4-4f03-a3a7-f66e6885ee1b tempest-VolumesActionsTest-1161214895 None] Detaching volume dbfa4737-d46b-474d-ac39-3db876eceac8 from instance 5cdd0310-9425-45c3-afd8-a9be3fcf9e8e. Nov 05 16:13:56 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b Nov 05 16:13:56 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:56 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:56 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8487531a-29c4-4f03-a3a7-f66e6885ee1b tempest-VolumesActionsTest-1161214895 None] Detach volume completed successfully. Nov 05 16:13:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8487531a-29c4-4f03-a3a7-f66e6885ee1b tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-detach_volume" released by "detach_volume" :: held 0.192s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:57 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b" returned: 0 in 0.862s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:57 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 Nov 05 16:13:57 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:57 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.895s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234bb65e-d7f6-445d-a982-4c58ebb41705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5f84dc-4031-432d-80c9-892ff2540049]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:57 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 Nov 05 16:13:57 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:57 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8" returned: 0 in 0.785s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:57 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8 Nov 05 16:13:57 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:57 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705" returned: 0 in 0.606s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:58 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:58 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:58 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b.467c08ae-a867-49cd-9678-1aef239ac2c8" returned: 0 in 0.397s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-467c08ae-a867-49cd-9678-1aef239ac2c8" released by "_delete_snapshot" :: held 3.427s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" released by "delete_snapshot" :: held 3.470s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Created reservations ['0f135394-187b-4ea1-8a77-dd39f6033a7a', 'f5d02322-a38d-4691-85f9-7309473dbf76', 'b653c193-0a5c-4e36-9e81-d02339e28985', 'd5c317e0-3d33-4f93-bd96-058d560194a9'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:58 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.527s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:58 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc Nov 05 16:13:58 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:58 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Delete snapshot completed successfully. Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bbe778ba-246a-45ec-b343-7fc001254ef9 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-467c08ae-a867-49cd-9678-1aef239ac2c8-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:58 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705.a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" returned: 0 in 0.399s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-quobyte-a446e01b-1678-4ca6-96b4-5d5e8a1f96dc" released by "_delete_snapshot" :: held 2.681s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" released by "delete_snapshot" :: held 2.765s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Created reservations ['f73e1a1f-1ffe-4147-bdc1-3d674115861f', '25cbb0dc-d3e6-4e44-9232-e4adb68ba988', '677f0be7-3d97-4156-9ddf-a9b9a5f0f679', 'cecf318b-5e75-4c0d-8986-51b207be7299'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:13:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Delete snapshot completed successfully. Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5afada0-324e-42d0-beae-81bfa4a43cb1 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-a446e01b-1678-4ca6-96b4-5d5e8a1f96dc-delete_snapshot" released by "delete_snapshot" :: held 2.969s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-a7a52f40-e66c-457a-90f5-25b6b86aba4b-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "cinder-234bb65e-d7f6-445d-a982-4c58ebb41705-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-234bb65e-d7f6-445d-a982-4c58ebb41705-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-a7a52f40-e66c-457a-90f5-25b6b86aba4b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" acquired by "delete_volume" :: waited 0.063s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c74499-8a98-4c29-b613-527a34868c86]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27c1edd-ccc9-4074-abca-75368f9ad109]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:13:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:13:59 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 Nov 05 16:13:59 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:13:59 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b Nov 05 16:13:59 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:00 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b" returned: 0 in 0.515s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:00 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705" returned: 0 in 0.569s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:00 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b Nov 05 16:14:00 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:00 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705 Nov 05 16:14:00 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "cinder-5d9d989e-7d4e-494e-aeee-899f4cef2db4-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-5d9d989e-7d4e-494e-aeee-899f4cef2db4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:00 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "cinder-quobyte-5d9d989e-7d4e-494e-aeee-899f4cef2db4" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a7a52f40-e66c-457a-90f5-25b6b86aba4b" returned: 0 in 0.386s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-quobyte-a7a52f40-e66c-457a-90f5-25b6b86aba4b" released by "delete_volume" :: held 1.015s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:00 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-quobyte-5d9d989e-7d4e-494e-aeee-899f4cef2db4" acquired by "delete_volume" :: waited 0.043s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-234bb65e-d7f6-445d-a982-4c58ebb41705" returned: 0 in 0.416s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-quobyte-234bb65e-d7f6-445d-a982-4c58ebb41705" released by "delete_volume" :: held 1.109s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d56102-117d-45ba-b919-149da2ee324e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Created reservations ['1b7bbdfc-4adc-4817-bc1e-653b5620d8ff', '7e82810f-10f3-4763-b6b8-9d0e184222ca', 'c341514a-9dd7-4591-a630-57ec22c60cc9', '619f280c-1ebf-4878-9499-623c0ee17d21'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Created reservations ['ec4f0f98-0df8-423b-8737-3e0ed3dc063d', 'adb94781-090f-40f9-b8b7-e59fcdb1128a', '38f14725-d100-481e-a12e-0c0936fa58bb', '14521499-a2ab-44e3-a784-3d58d5b00e8e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:00 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 Nov 05 16:14:00 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:01 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:01 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:01 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:01 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:01 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Deleted volume successfully. Nov 05 16:14:01 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4d55b4c-b94b-4b99-aa31-5591e0bbfca1 tempest-VolumesSnapshotListTestJSON-1138788973 None] Lock "cinder-a7a52f40-e66c-457a-90f5-25b6b86aba4b-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4" returned: 0 in 0.491s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:01 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:01 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4 Nov 05 16:14:01 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.301s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Deleted volume successfully. Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6323b567-a88b-4085-a10e-334884801571 tempest-SnapshotsActionsTest-1870586508 None] Lock "cinder-234bb65e-d7f6-445d-a982-4c58ebb41705-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:01 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5d9d989e-7d4e-494e-aeee-899f4cef2db4" returned: 0 in 0.292s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-quobyte-5d9d989e-7d4e-494e-aeee-899f4cef2db4" released by "delete_volume" :: held 0.858s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Created reservations ['8fd7df8b-f985-4526-b137-7cf1ef85fc29', 'a7d2bdb5-c0a4-4fff-9c9b-c9aa612916d1', '5d74e312-4f56-40a5-8dd7-72d75ee105b3', 'c37e8a4e-5dbe-4bbf-b241-90d39d8ec20d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:01 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:01 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "cinder-d03068c8-0441-4b70-a92d-a0bf9037e32c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-d03068c8-0441-4b70-a92d-a0bf9037e32c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "cinder-quobyte-d03068c8-0441-4b70-a92d-a0bf9037e32c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-quobyte-d03068c8-0441-4b70-a92d-a0bf9037e32c" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6de980-6f5f-46bb-b7b6-766496080971]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:02 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Deleted volume successfully. Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fc38a8ba-22db-4b62-a9f9-a4d0e86a1d55 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-5d9d989e-7d4e-494e-aeee-899f4cef2db4-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:02 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c Nov 05 16:14:02 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:02 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c" returned: 0 in 0.489s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:02 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c Nov 05 16:14:02 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaea6d4-0ec0-41a8-96f8-30820fa47dcf]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:03 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d03068c8-0441-4b70-a92d-a0bf9037e32c" returned: 0 in 0.323s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-quobyte-d03068c8-0441-4b70-a92d-a0bf9037e32c" released by "delete_volume" :: held 0.881s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:03 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:03 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Created reservations ['b6f32660-85c2-4f4a-8fb5-ce87a0ee48f3', '0cd82f7f-6577-4def-b9e8-1917fb8e7217', '0afab77f-02a1-4824-a809-5a42abe2c02e', '91523768-72a2-4a7e-945b-068481b89e60'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:03 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:03 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:03 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.476s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4517c815-896e-495e-bbbc-c97d9453aa68]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:03 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:03 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:03 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.399s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:03 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Deleted volume successfully. Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "cinder-249bc79c-4960-4b3d-b092-7320faa85cc5-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-feaee1da-cf7e-45ef-b129-c97dff0ae620 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-d03068c8-0441-4b70-a92d-a0bf9037e32c-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-249bc79c-4960-4b3d-b092-7320faa85cc5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "cinder-quobyte-249bc79c-4960-4b3d-b092-7320faa85cc5" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-quobyte-249bc79c-4960-4b3d-b092-7320faa85cc5" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6655598-1283-4f59-9b3b-52f16d8690c6]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:04 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 Nov 05 16:14:04 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:04 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.581s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.33d02906-f6aa-4691-97c5-c3b2eb4003c2jezn5r0q.img {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:04 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.33d02906-f6aa-4691-97c5-c3b2eb4003c2jezn5r0q.img Nov 05 16:14:04 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:04 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5" returned: 0 in 0.484s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:04 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5 Nov 05 16:14:04 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:04 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-249bc79c-4960-4b3d-b092-7320faa85cc5" returned: 0 in 0.579s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-quobyte-249bc79c-4960-4b3d-b092-7320faa85cc5" released by "delete_volume" :: held 1.154s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Created reservations ['dac7169a-93a6-486b-81e3-cc386b49bae9', '066e2f67-b829-47ed-84c7-48e7e2fb4e3a', 'd7f70951-fcfd-4650-9035-bad00d382d6e', 'a5054a74-9d39-456f-a362-adcf3b7acfe7'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:05 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:05 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:05 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.547s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Deleted volume successfully. Nov 05 16:14:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20381a60-72df-4c59-8f18-b2241aeb7f62 tempest-AttachVolumeNegativeTest-129395497 None] Lock "cinder-249bc79c-4960-4b3d-b092-7320faa85cc5-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Flow 'volume_create_manager' (1330cb85-ec84-4192-9805-026bc1008019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23da019-5032-4671-9473-03b8a1f7a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23da019-5032-4671-9473-03b8a1f7a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1673204809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6995f2-adf1-41ce-a4d7-3f41b33776b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f03ea0d40c4e1e91e22fbd28650e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:11Z,use_quota=True,user_id='7087376374f2470aa191731355ea8c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9bc234-6d2a-43cb-8496-0d2b40428c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9bc234-6d2a-43cb-8496-0d2b40428c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234c4a48-9853-4254-b25a-eccac40e8afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234c4a48-9853-4254-b25a-eccac40e8afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6995f2-adf1-41ce-a4d7-3f41b33776b1', 'volume_name': 'volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1', 'volume_size': 2}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcacc51-9022-4091-bc49-6a44d5bf9446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcacc51-9022-4091-bc49-6a44d5bf9446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909636e0-0aa4-4edc-9749-6fde1131bbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:11 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Volume 7b6995f2-adf1-41ce-a4d7-3f41b33776b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1', 'volume_size': 2} Nov 05 16:14:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.33d02906-f6aa-4691-97c5-c3b2eb4003c2jezn5r0q.img" returned: 0 in 8.772s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:12 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d32854-38e4-47c3-9fcb-d5a19e13a1ac]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:12 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:12 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:13 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.654s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:13 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8, size 1024.00 MB, duration 8.77 sec, destination /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.33d02906-f6aa-4691-97c5-c3b2eb4003c2jezn5r0q.img {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:14:13 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Converted 1024.00 MB image at 116.72 MB/s Nov 05 16:14:13 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] 33d02906-f6aa-4691-97c5-c3b2eb4003c2 was raw, no need to convert to raw {{(pid=86924) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1191}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=130,cinder:SELECT=127,cinder:INSERT=35,cinder:DELETE=7 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=116,cinder:UPDATE=113,cinder:INSERT=31,cinder:DELETE=11 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Flow 'volume_create_manager' (2f9cfe00-8c24-458d-8298-41abcbb57f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7905755d-8020-462d-b43b-fe8bee12390f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7905755d-8020-462d-b43b-fe8bee12390f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550699683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6eff632-ecd0-46ee-87a4-f0bd6a058927,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e73c70bac12b4e69b02763c759bc056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:18Z,use_quota=True,user_id='a3dbeda18d544c5b93d067bb3992ed35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6dbd6d-47e3-43fb-85cb-fe2aa1495443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6dbd6d-47e3-43fb-85cb-fe2aa1495443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d21d1fa-8918-4fcd-a470-a84772c67a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d21d1fa-8918-4fcd-a470-a84772c67a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6eff632-ecd0-46ee-87a4-f0bd6a058927', 'volume_name': 'volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6365ac-3126-48c5-b5a8-32fc411940fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6365ac-3126-48c5-b5a8-32fc411940fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500c3107-a6de-4148-af1c-850deb8852de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Volume c6eff632-ecd0-46ee-87a4-f0bd6a058927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927', 'volume_size': 1} Nov 05 16:14:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Flow 'volume_create_manager' (cea08aaa-95bb-4fb5-8e5c-7d83096420b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877be38-7c5e-4a8c-8367-c57727f3cd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7877be38-7c5e-4a8c-8367-c57727f3cd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-951089477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedfb6e2-4954-4215-8885-e239733f7f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='138f0b68abe44f6f9b665906cd29768e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:21Z,use_quota=True,user_id='8a1f07b3005a4bc09d70faf088df092f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def7ac42-a683-48cf-b6af-ca3ea4a18772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def7ac42-a683-48cf-b6af-ca3ea4a18772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4109a00-ee55-4c7f-91a5-607a3414bb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4109a00-ee55-4c7f-91a5-607a3414bb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bedfb6e2-4954-4215-8885-e239733f7f64', 'volume_name': 'volume-bedfb6e2-4954-4215-8885-e239733f7f64', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442fc4e-1928-4b1d-ab6a-9eededc2ab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442fc4e-1928-4b1d-ab6a-9eededc2ab5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4bda82-3120-40ed-9596-93f1b56606e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:21 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Volume bedfb6e2-4954-4215-8885-e239733f7f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bedfb6e2-4954-4215-8885-e239733f7f64', 'volume_size': 1} Nov 05 16:14:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:31 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:14:31 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=3 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.538s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Uploaded volume to glance image-id: 33d02906-f6aa-4691-97c5-c3b2eb4003c2. {{(pid=86924) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.208s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1673204809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6995f2-adf1-41ce-a4d7-3f41b33776b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f03ea0d40c4e1e91e22fbd28650e4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:11Z,use_quota=True,user_id='7087376374f2470aa191731355ea8c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Creating volume 7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:14:34 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 2147483648 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:34 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 2147483648 Nov 05 16:14:34 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:34 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5f98dd9a-4bf4-49e5-8fb7-46a0151a6c8c tempest-VolumesActionsTest-1161214895 None] Copy volume to image completed successfully. Nov 05 16:14:34 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 2147483648" returned: 0 in 0.458s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:35 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 Nov 05 16:14:35 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:35 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" returned: 0 in 0.229s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.665s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550699683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6eff632-ecd0-46ee-87a4-f0bd6a058927,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e73c70bac12b4e69b02763c759bc056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:18Z,use_quota=True,user_id='a3dbeda18d544c5b93d067bb3992ed35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Creating volume c6eff632-ecd0-46ee-87a4-f0bd6a058927 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:14:35 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909636e0-0aa4-4edc-9749-6fde1131bbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1', 'volume_size': 2}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:35 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 1073741824 Nov 05 16:14:35 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c26817f-ee13-4d27-b7bf-bb69678ce4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:35 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Volume volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 (7b6995f2-adf1-41ce-a4d7-3f41b33776b1): created successfully Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c26817f-ee13-4d27-b7bf-bb69678ce4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Flow 'volume_create_manager' (1330cb85-ec84-4192-9805-026bc1008019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3f64b395-3cc7-467c-9671-d5e26741a4a2 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Created volume successfully. Nov 05 16:14:35 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 1073741824" returned: 0 in 0.460s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:35 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 Nov 05 16:14:35 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:35 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927" returned: 0 in 0.274s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.571s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-951089477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bedfb6e2-4954-4215-8885-e239733f7f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='138f0b68abe44f6f9b665906cd29768e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:21Z,use_quota=True,user_id='8a1f07b3005a4bc09d70faf088df092f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Creating volume bedfb6e2-4954-4215-8885-e239733f7f64 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:14:36 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:36 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 1073741824 Nov 05 16:14:36 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500c3107-a6de-4148-af1c-850deb8852de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dd6875-635c-4a76-897a-a879f788a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:36 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Volume volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 (c6eff632-ecd0-46ee-87a4-f0bd6a058927): created successfully Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dd6875-635c-4a76-897a-a879f788a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Flow 'volume_create_manager' (2f9cfe00-8c24-458d-8298-41abcbb57f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-630468d9-01a2-4a14-bbb3-cb5354d92862 tempest-VolumesTestJSON-1550107602 None] Created volume successfully. Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:36 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 1073741824" returned: 0 in 0.484s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:36 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 Nov 05 16:14:36 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:36 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.658s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4bda82-3120-40ed-9596-93f1b56606e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bedfb6e2-4954-4215-8885-e239733f7f64', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc9529f-042f-400d-9aaa-29b81762a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Creating offline snapshot 589e8bfd-0755-4cb5-8f49-1eefa70e59cc of volume 7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:14:36 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Volume volume-bedfb6e2-4954-4215-8885-e239733f7f64 (bedfb6e2-4954-4215-8885-e239733f7f64): created successfully Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc9529f-042f-400d-9aaa-29b81762a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Flow 'volume_create_manager' (cea08aaa-95bb-4fb5-8e5c-7d83096420b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85618f6-317d-4275-bc3a-dea9a72097ff]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-372869ba-24d6-498a-9fc1-cca7b2e9fef4 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Created volume successfully. Nov 05 16:14:36 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 Nov 05 16:14:36 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Flow 'volume_create_manager' (b9801397-a5b9-4d55-bc1c-99918ec8050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5de7211-c508-467a-9783-d66f0c5c0b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5de7211-c508-467a-9783-d66f0c5c0b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1231541461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4221ea68-b22a-4734-a39f-ee8a82bf9c67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e73c70bac12b4e69b02763c759bc056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:37Z,use_quota=True,user_id='a3dbeda18d544c5b93d067bb3992ed35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3966c6-a666-4920-a2a8-6a2b8ad7a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3966c6-a666-4920-a2a8-6a2b8ad7a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d502a0-ddb6-49a8-a113-c770b1be1e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d502a0-ddb6-49a8-a113-c770b1be1e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4221ea68-b22a-4734-a39f-ee8a82bf9c67', 'volume_name': 'volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb04b0b-96d7-4e08-b8e2-b5ba126d5e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb04b0b-96d7-4e08-b8e2-b5ba126d5e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810b9cf0-12e8-4d51-8cdc-54a9490feed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Volume 4221ea68-b22a-4734-a39f-ee8a82bf9c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67', 'volume_size': 1} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:37 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" returned: 0 in 0.391s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc 2G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:37 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc 2G Nov 05 16:14:37 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:37 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc 2G" returned: 0 in 0.434s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:37 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc Nov 05 16:14:37 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:37 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc" returned: 0 in 0.297s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:37 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc is being set with open permissions: ugo+rw Nov 05 16:14:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:37 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc Nov 05 16:14:37 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:38 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc" returned: 0 in 0.282s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:38 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.info Nov 05 16:14:38 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Acquiring lock "cinder-bedfb6e2-4954-4215-8885-e239733f7f64-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "cinder-bedfb6e2-4954-4215-8885-e239733f7f64-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Acquiring lock "cinder-quobyte-bedfb6e2-4954-4215-8885-e239733f7f64" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "cinder-quobyte-bedfb6e2-4954-4215-8885-e239733f7f64" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eab308-5163-4cea-bc45-1112697d315b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:38 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.info" returned: 0 in 0.285s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:38 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.info is being set with open permissions: ugo+rw Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:38 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 Nov 05 16:14:38 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:38 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.info Nov 05 16:14:38 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:38 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.info" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.494s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:38 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64" returned: 0 in 0.361s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43cd00d-e4ea-41f1-9cf4-d20ddc93b78e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:38 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64 Nov 05 16:14:38 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d6bbc179-aa59-41f6-8fac-8d8f8f186e30 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Create snapshot completed successfully Nov 05 16:14:38 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:38 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:39 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bedfb6e2-4954-4215-8885-e239733f7f64" returned: 0 in 0.263s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "cinder-quobyte-bedfb6e2-4954-4215-8885-e239733f7f64" released by "delete_volume" :: held 0.669s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Created reservations ['bac46ab9-9fac-4ffc-802b-54d578876fe6', '52e5f179-53d9-4f3f-a4a5-8aad2f7fb6fb', '414e624b-bccf-44ec-9f88-92d4d80e3ce0', 'ff3911ad-bd77-49aa-9cd4-c38e0d3a7bef'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:39 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:39 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:39 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8cc44d-997e-4a26-a7e4-ced31496adc8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:39 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:39 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "cinder-589e8bfd-0755-4cb5-8f49-1eefa70e59cc-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-589e8bfd-0755-4cb5-8f49-1eefa70e59cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "cinder-quobyte-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-quobyte-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "cinder-quobyte-589e8bfd-0755-4cb5-8f49-1eefa70e59cc" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-quobyte-589e8bfd-0755-4cb5-8f49-1eefa70e59cc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Deleting offline snapshot 589e8bfd-0755-4cb5-8f49-1eefa70e59cc of volume 7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] snapshot_file for this snap is: volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:14:39 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Deleted volume successfully. Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df96dd92-07af-4833-a767-9708bc6dd23f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-05751e7e-a2d1-4766-b124-f93303378ca1 tempest-VolumeQuotasNegativeTestJSON-32609771 None] Lock "cinder-bedfb6e2-4954-4215-8885-e239733f7f64-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:39 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.408s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:39 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc Nov 05 16:14:39 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:39 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img Nov 05 16:14:39 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:39 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc" returned: 0 in 0.417s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:14:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f8a50d-542c-43de-8d57-23778d04ded3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:40 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 Nov 05 16:14:40 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:40 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" returned: 0 in 0.768s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:40 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc Nov 05 16:14:40 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:41 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc" returned: 0 in 0.591s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:41 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc Nov 05 16:14:41 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:41 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1.589e8bfd-0755-4cb5-8f49-1eefa70e59cc" returned: 0 in 0.517s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-quobyte-589e8bfd-0755-4cb5-8f49-1eefa70e59cc" released by "_delete_snapshot" :: held 2.527s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-quobyte-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" released by "delete_snapshot" :: held 2.570s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:42 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Created reservations ['4f240bc7-6b5e-4fa0-adbf-1c0315e6ccf4', '752709a9-8bc7-443a-8819-edc0455ab8af', 'd61ccf94-ccec-4872-b88d-0c0af77b4af6', 'bf3be23e-ef57-4708-905d-09d07e17533b'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Delete snapshot completed successfully. Nov 05 16:14:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-049220cc-44c5-43f3-a4fa-3752c2d93a59 tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-589e8bfd-0755-4cb5-8f49-1eefa70e59cc-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "cinder-7b6995f2-adf1-41ce-a4d7-3f41b33776b1-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-7b6995f2-adf1-41ce-a4d7-3f41b33776b1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "cinder-quobyte-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-quobyte-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[121cfaee-927b-4674-9687-d617cc64e47c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:43 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 Nov 05 16:14:43 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:43 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" returned: 0 in 0.662s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:43 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1 Nov 05 16:14:43 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:44 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" returned: 0 in 0.460s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-quobyte-7b6995f2-adf1-41ce-a4d7-3f41b33776b1" released by "delete_volume" :: held 1.290s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Created reservations ['9b3da5e5-a60a-47a0-b2c0-09fe1ea0fea2', 'a27721fe-7d9e-42c9-abc5-9c72d9d51c6d', '6bdbe8a6-a006-4634-8bce-276a4dfbbfc0', '80c8259e-1e8d-4f9e-9263-5e0c2c64fba2'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:44 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:44 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:45 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:45 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Deleted volume successfully. Nov 05 16:14:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ec28e6a-e51c-4b0a-bc20-b5b8a5c72b8e tempest-VolumesSnapshotNegativeTestJSON-1668301418 None] Lock "cinder-7b6995f2-adf1-41ce-a4d7-3f41b33776b1-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:47 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img" returned: 0 in 7.749s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:47 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd1b36-a9a2-40bd-92ca-1a3819057b50]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:47 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:47 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:48 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.640s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:14:48 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Converted 1024.00 MB image at 132.13 MB/s Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] 2b25acde-1032-4c60-a6b9-8113d7ff9498 was raw, converting to qcow2 {{(pid=86924) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1208}} Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e974839-0eff-4439-a79c-85432f8105be]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:48 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img Nov 05 16:14:48 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:48 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img" returned: 0 in 0.323s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:48 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img Nov 05 16:14:48 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:48 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img" returned: 1 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:14:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img /opt/stack/data/cinder/conversion/vol_upload_enaheau8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:48 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img /opt/stack/data/cinder/conversion/vol_upload_enaheau8 Nov 05 16:14:48 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:49 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img /opt/stack/data/cinder/conversion/vol_upload_enaheau8" returned: 0 in 0.286s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:49 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Image conversion details: src /opt/stack/data/cinder/conversion/dbfa4737-d46b-474d-ac39-3db876eceac8.temp_image.2b25acde-1032-4c60-a6b9-8113d7ff9498z3qud1aj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_enaheau8 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:14:49 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 16:14:49 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43fc28-bafa-4082-b0fa-c8fbd220f7f0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_enaheau8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:49 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_enaheau8 Nov 05 16:14:49 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:49 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_enaheau8" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:50 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:50 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:50 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.335s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Flow 'volume_create_manager' (f4727cbf-b7ca-4103-8cba-830cb769c96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d6bb9a-ec40-48b8-8a4d-dc8f5f8bf849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d6bb9a-ec40-48b8-8a4d-dc8f5f8bf849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1121637529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a60373-5eb2-4146-9d57-57b29f893111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e8b96d33fe4ad9b9d0101bb72dd844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:51Z,use_quota=True,user_id='75a848b3ff1e425ab6a3691d3b33f52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67363d82-806d-464c-813e-f8d7829af0b9),volume_type_id=67363d82-806d-464c-813e-f8d7829af0b9)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaf2c87-a345-4066-aae8-e3b17702d12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaf2c87-a345-4066-aae8-e3b17702d12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255746ac-d28c-44f3-9d99-ae9f47962082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255746ac-d28c-44f3-9d99-ae9f47962082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a60373-5eb2-4146-9d57-57b29f893111', 'volume_name': 'volume-e3a60373-5eb2-4146-9d57-57b29f893111', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68b7fa9-038a-4c44-9240-f7b3b7dc8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68b7fa9-038a-4c44-9240-f7b3b7dc8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04900fb7-80f4-475c-9d14-aa4db6978c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:50 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Volume e3a60373-5eb2-4146-9d57-57b29f893111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a60373-5eb2-4146-9d57-57b29f893111', 'volume_size': 1} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.150s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Uploaded volume to glance image-id: 2b25acde-1032-4c60-a6b9-8113d7ff9498. {{(pid=86924) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.811s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1231541461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4221ea68-b22a-4734-a39f-ee8a82bf9c67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e73c70bac12b4e69b02763c759bc056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:37Z,use_quota=True,user_id='a3dbeda18d544c5b93d067bb3992ed35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Creating volume 4221ea68-b22a-4734-a39f-ee8a82bf9c67 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:14:50 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:51 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 1073741824 Nov 05 16:14:51 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b2840deb-ee37-4071-8daf-f7d8736928bf tempest-VolumesActionsTest-1161214895 None] Copy volume to image completed successfully. Nov 05 16:14:51 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 1073741824" returned: 0 in 0.494s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:51 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 Nov 05 16:14:51 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:51 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67" returned: 0 in 0.290s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.069s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1121637529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a60373-5eb2-4146-9d57-57b29f893111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e8b96d33fe4ad9b9d0101bb72dd844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:51Z,use_quota=True,user_id='75a848b3ff1e425ab6a3691d3b33f52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67363d82-806d-464c-813e-f8d7829af0b9),volume_type_id=67363d82-806d-464c-813e-f8d7829af0b9)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Creating volume e3a60373-5eb2-4146-9d57-57b29f893111 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:14:51 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810b9cf0-12e8-4d51-8cdc-54a9490feed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ee488b-0a6c-4d58-9b5d-f8df9e0fd22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:51 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 1073741824 Nov 05 16:14:51 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:51 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Volume volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 (4221ea68-b22a-4734-a39f-ee8a82bf9c67): created successfully Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ee488b-0a6c-4d58-9b5d-f8df9e0fd22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Flow 'volume_create_manager' (b9801397-a5b9-4d55-bc1c-99918ec8050a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e7a9338c-1c65-451e-93fa-072a67a87503 tempest-VolumesTestJSON-1550107602 None] Created volume successfully. Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "cinder-quobyte-dbfa4737-d46b-474d-ac39-3db876eceac8" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-quobyte-dbfa4737-d46b-474d-ac39-3db876eceac8" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2565c8e5-a86b-402a-812a-62e39e8c42af]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:52 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:52 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:52 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 1073741824" returned: 0 in 0.477s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:52 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 Nov 05 16:14:52 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:52 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.447s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:52 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8 Nov 05 16:14:52 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:52 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04900fb7-80f4-475c-9d14-aa4db6978c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a60373-5eb2-4146-9d57-57b29f893111', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e830805d-46e6-4e50-bd0c-65238811cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:52 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Volume volume-e3a60373-5eb2-4146-9d57-57b29f893111 (e3a60373-5eb2-4146-9d57-57b29f893111): created successfully Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e830805d-46e6-4e50-bd0c-65238811cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Flow 'volume_create_manager' (f4727cbf-b7ca-4103-8cba-830cb769c96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:52 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-168cc1c6-0f73-4e07-a8c1-3fa63e97fdcb tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Created volume successfully. Nov 05 16:14:52 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dbfa4737-d46b-474d-ac39-3db876eceac8" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-quobyte-dbfa4737-d46b-474d-ac39-3db876eceac8" released by "delete_volume" :: held 0.849s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Created reservations ['0a8303e0-21b3-4a42-b977-11f4713d6cc0', '407c3eeb-0182-4f57-add9-0e85aae9b7f8', 'a5429aa3-34d7-4682-8b6c-0dc22061ddaa', 'eaafa8ae-7740-4514-b8fc-5618782370a6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:52 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:52 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Flow 'volume_create_manager' (4ccf5282-960e-4f74-8882-e1ca0fa53388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e196fa-b52b-49ba-a70a-39ee5e656dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e196fa-b52b-49ba-a70a-39ee5e656dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1728417683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209e3b19-c87e-4a54-b28b-f35ed83addef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e73c70bac12b4e69b02763c759bc056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:53Z,use_quota=True,user_id='a3dbeda18d544c5b93d067bb3992ed35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4a103f-b621-4f73-ba2a-ceb259982cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4a103f-b621-4f73-ba2a-ceb259982cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899a0d1b-feef-4ce7-83e0-0aa599827eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899a0d1b-feef-4ce7-83e0-0aa599827eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209e3b19-c87e-4a54-b28b-f35ed83addef', 'volume_name': 'volume-209e3b19-c87e-4a54-b28b-f35ed83addef', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7abbbc-3ce0-4c88-8079-be69a9b49b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7abbbc-3ce0-4c88-8079-be69a9b49b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca360d8-d761-41de-8797-c1851f597c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:53 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Volume 209e3b19-c87e-4a54-b28b-f35ed83addef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209e3b19-c87e-4a54-b28b-f35ed83addef', 'volume_size': 1} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1728417683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209e3b19-c87e-4a54-b28b-f35ed83addef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e73c70bac12b4e69b02763c759bc056e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:53Z,use_quota=True,user_id='a3dbeda18d544c5b93d067bb3992ed35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Creating volume 209e3b19-c87e-4a54-b28b-f35ed83addef {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:14:53 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:53 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef 1073741824 Nov 05 16:14:53 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:53 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.365s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Deleted volume successfully. Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1615106-3a64-4669-9199-5a9b72db10d1 tempest-VolumesActionsTest-1161214895 None] Lock "cinder-dbfa4737-d46b-474d-ac39-3db876eceac8-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:53 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef 1073741824" returned: 0 in 0.587s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:53 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef Nov 05 16:14:53 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:54 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef" returned: 0 in 0.292s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca360d8-d761-41de-8797-c1851f597c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209e3b19-c87e-4a54-b28b-f35ed83addef', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1aceea-48db-44af-be17-a45e6fc4d767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Volume volume-209e3b19-c87e-4a54-b28b-f35ed83addef (209e3b19-c87e-4a54-b28b-f35ed83addef): created successfully Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1aceea-48db-44af-be17-a45e6fc4d767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Flow 'volume_create_manager' (4ccf5282-960e-4f74-8882-e1ca0fa53388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Flow 'volume_create_manager' (76b0f6e5-4587-41ed-a1de-e42c87fad4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa7eaaa-12d9-44cc-a9bb-a04bc8824eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bf7cb723-d657-4a34-bc28-251c6f51ef32 tempest-VolumesTestJSON-1550107602 None] Created volume successfully. Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa7eaaa-12d9-44cc-a9bb-a04bc8824eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8442388-fe64-46d2-8835-74c199c40516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e771a0b769443d5ba1ba11ac06ab009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:54Z,use_quota=True,user_id='49e6ee21d903477a9eb6cf8ea77b6dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92da0c28-c777-4c7f-9e56-09d4b9438316),volume_type_id=92da0c28-c777-4c7f-9e56-09d4b9438316)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0ebfbd-ade0-4ca4-85a7-0e62f7a1129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0ebfbd-ade0-4ca4-85a7-0e62f7a1129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c7762f-e3b4-4908-8bfe-668a464e9e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:54 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:54 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c7762f-e3b4-4908-8bfe-668a464e9e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8442388-fe64-46d2-8835-74c199c40516', 'volume_name': 'volume-c8442388-fe64-46d2-8835-74c199c40516', 'volume_size': 1, 'image_id': '703fbc9d-c142-441f-a2fb-fc222d705ed5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/703fbc9d-c142-441f-a2fb-fc222d705ed5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd510fcdb9b03fe0491768e9ecc1fbc0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e771a0b769443d5ba1ba11ac06ab009', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca5e672f10b1fcd2f255894e62c04fa45e8ae156471f1350cb95b94a7cf9fce4aa3b139855538287290f7334a1ed12787f341b0b8ee9537bda153978a84434f', 'id': '703fbc9d-c142-441f-a2fb-fc222d705ed5', 'created_at': datetime.datetime(2026, 11, 5, 15, 14, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 14, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/703fbc9d-c142-441f-a2fb-fc222d705ed5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f528dbc-a635-4589-b183-723a72b49056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f528dbc-a635-4589-b183-723a72b49056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e3e89f-2bae-4d1b-95eb-23d1160c47dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:14:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Volume c8442388-fe64-46d2-8835-74c199c40516: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8442388-fe64-46d2-8835-74c199c40516', 'volume_size': 1, 'image_id': '703fbc9d-c142-441f-a2fb-fc222d705ed5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/703fbc9d-c142-441f-a2fb-fc222d705ed5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd510fcdb9b03fe0491768e9ecc1fbc0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e771a0b769443d5ba1ba11ac06ab009', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca5e672f10b1fcd2f255894e62c04fa45e8ae156471f1350cb95b94a7cf9fce4aa3b139855538287290f7334a1ed12787f341b0b8ee9537bda153978a84434f', 'id': '703fbc9d-c142-441f-a2fb-fc222d705ed5', 'created_at': datetime.datetime(2026, 11, 5, 15, 14, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 14, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/703fbc9d-c142-441f-a2fb-fc222d705ed5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Trying to clone c8442388-fe64-46d2-8835-74c199c40516 from image 703fbc9d-c142-441f-a2fb-fc222d705ed5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/703fbc9d-c142-441f-a2fb-fc222d705ed5', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:14:54 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Image download 0.00 MB at 0.00 MB/s Nov 05 16:14:54 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0b2deb2b-7285-47db-bb4c-15c38e655c23 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Retype volume completed successfully. Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f223b2-6104-47b5-87d3-981712bfe328]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:54 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD Nov 05 16:14:54 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:55 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:55 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD Nov 05 16:14:55 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:55 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Temporary image 703fbc9d-c142-441f-a2fb-fc222d705ed5 is fetched for user 49e6ee21d903477a9eb6cf8ea77b6dca. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801b6fa-167c-4bf8-aad0-abe0329fe848]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:55 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD Nov 05 16:14:55 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Acquiring lock "cinder-e3a60373-5eb2-4146-9d57-57b29f893111-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "cinder-e3a60373-5eb2-4146-9d57-57b29f893111-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Acquiring lock "cinder-quobyte-e3a60373-5eb2-4146-9d57-57b29f893111" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "cinder-quobyte-e3a60373-5eb2-4146-9d57-57b29f893111" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa65d50-b8ce-456e-ae72-4662861a96a1]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:56 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:56 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 Nov 05 16:14:56 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:56 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD Nov 05 16:14:56 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "cinder-209e3b19-c87e-4a54-b28b-f35ed83addef-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-209e3b19-c87e-4a54-b28b-f35ed83addef-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:56 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "cinder-quobyte-209e3b19-c87e-4a54-b28b-f35ed83addef" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8442388-fe64-46d2-8835-74c199c40516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e771a0b769443d5ba1ba11ac06ab009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:14:54Z,use_quota=True,user_id='49e6ee21d903477a9eb6cf8ea77b6dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92da0c28-c777-4c7f-9e56-09d4b9438316),volume_type_id=92da0c28-c777-4c7f-9e56-09d4b9438316)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Creating volume c8442388-fe64-46d2-8835-74c199c40516 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:14:56 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:56 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 1073741824 Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-quobyte-209e3b19-c87e-4a54-b28b-f35ed83addef" acquired by "delete_volume" :: waited 0.047s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:56 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:56 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111" returned: 0 in 0.508s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5887f5-fa20-4843-bf7e-2c7cc09e4196]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:56 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111 Nov 05 16:14:56 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:56 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef Nov 05 16:14:56 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:56 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e3a60373-5eb2-4146-9d57-57b29f893111" returned: 0 in 0.357s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "cinder-quobyte-e3a60373-5eb2-4146-9d57-57b29f893111" released by "delete_volume" :: held 0.930s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:57 devstack cinder-volume[86924]: WARNING cinder.quota [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:14:57 devstack cinder-volume[86924]: WARNING cinder.quota [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Created reservations ['0769db99-7422-47cc-b42f-aa24353f2ffc', 'c19d23ed-62bd-4668-901d-8ce0969559de', 'ad41a68d-1f10-46d6-9d10-0b0d1d2c67ac', 'a828a70f-e600-41b3-a742-873c4efd7c0f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:57 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef" returned: 0 in 0.541s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:57 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:57 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef Nov 05 16:14:57 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 1073741824" returned: 0 in 0.666s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:57 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:57 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:57 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 Nov 05 16:14:57 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:57 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-209e3b19-c87e-4a54-b28b-f35ed83addef" returned: 0 in 0.333s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-quobyte-209e3b19-c87e-4a54-b28b-f35ed83addef" released by "delete_volume" :: held 0.960s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:57 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516" returned: 0 in 0.315s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:57 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.400s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Attempting download of 703fbc9d-c142-441f-a2fb-fc222d705ed5 ((None, [{'url': 'file:///opt/stack/data/glance/images/703fbc9d-c142-441f-a2fb-fc222d705ed5', 'metadata': {}}])) to volume c8442388-fe64-46d2-8835-74c199c40516. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:14:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Deleted volume successfully. Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Created reservations ['f836c437-87e0-40ea-aace-7e8c199c4d85', '31815f07-4d9c-4c4d-8e82-fc5de6882ea8', '60309aa1-6a3d-4550-a438-1893e5520064', 'ab0e512c-4cdc-41fa-99a8-c53414a74a1d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-06fc4167-d1bb-49f3-b894-320752639230 tempest-VolumeRetypeWithoutMigrationTest-1798321139 None] Lock "cinder-e3a60373-5eb2-4146-9d57-57b29f893111-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6fd66c-e2ee-4186-905f-788dcee639f6]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_703fbc9d-c142-441f-a2fb-fc222d705ed5_v_waevx5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:57 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:57 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:57 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_703fbc9d-c142-441f-a2fb-fc222d705ed5_v_waevx5 Nov 05 16:14:57 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:58 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.333s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:14:58 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Deleted volume successfully. Nov 05 16:14:58 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_703fbc9d-c142-441f-a2fb-fc222d705ed5_v_waevx5" returned: 0 in 0.403s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703fbc9d-c142-441f-a2fb-fc222d705ed5_v_waevx5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-83d1aaa1-bc03-4988-9503-53191db1f223 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-209e3b19-c87e-4a54-b28b-f35ed83addef-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:58 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703fbc9d-c142-441f-a2fb-fc222d705ed5_v_waevx5 Nov 05 16:14:58 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:58 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703fbc9d-c142-441f-a2fb-fc222d705ed5_v_waevx5" returned: 1 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703fbc9d-c142-441f-a2fb-fc222d705ed5_v_waevx5' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e271b6-1d77-4eee-8965-7d108ba6159c]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:58 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD Nov 05 16:14:58 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "cinder-4221ea68-b22a-4734-a39f-ee8a82bf9c67-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-4221ea68-b22a-4734-a39f-ee8a82bf9c67-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "cinder-quobyte-4221ea68-b22a-4734-a39f-ee8a82bf9c67" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-quobyte-4221ea68-b22a-4734-a39f-ee8a82bf9c67" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[89238caf-b038-4731-9ea0-8e96448bf65d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:58 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:58 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 Nov 05 16:14:58 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:59 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD Nov 05 16:14:59 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:59 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] 703fbc9d-c142-441f-a2fb-fc222d705ed5 was raw, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:14:59 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67" returned: 0 in 0.500s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:59 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 Nov 05 16:14:59 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:59 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67 Nov 05 16:14:59 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:59 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4221ea68-b22a-4734-a39f-ee8a82bf9c67" returned: 0 in 0.375s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-quobyte-4221ea68-b22a-4734-a39f-ee8a82bf9c67" released by "delete_volume" :: held 0.936s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Created reservations ['5292483e-f0e4-40f0-9bfb-f99f1b482dca', '6a805f13-c8ba-4c40-ba91-da418365d9a1', 'd5eebdf3-1869-4901-9956-5aa8cca97499', '92437984-8279-4611-9a51-151e090c54de'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:14:59 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:14:59 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:14:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Acquiring lock "cinder-c6eff632-ecd0-46ee-87a4-f0bd6a058927-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:00 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Lock "cinder-c6eff632-ecd0-46ee-87a4-f0bd6a058927-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516" returned: 0 in 0.719s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_703fbc9d-c142-441f-a2fb-fc222d705ed5_t3552qivdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:15:00 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:00 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 1G Nov 05 16:15:00 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Acquiring lock "cinder-quobyte-c6eff632-ecd0-46ee-87a4-f0bd6a058927" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Lock "cinder-quobyte-c6eff632-ecd0-46ee-87a4-f0bd6a058927" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03498165-14ca-4400-aac4-45b874eda15c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:00 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.381s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Deleted volume successfully. Nov 05 16:15:00 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 Nov 05 16:15:00 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c857eb22-40af-4359-8f08-52e2b1adac67 tempest-VolumesTestJSON-1550107602 None] Lock "cinder-4221ea68-b22a-4734-a39f-ee8a82bf9c67-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:00 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 1G" returned: 0 in 0.433s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Downloaded image 703fbc9d-c142-441f-a2fb-fc222d705ed5 ((None, [{'url': 'file:///opt/stack/data/glance/images/703fbc9d-c142-441f-a2fb-fc222d705ed5', 'metadata': {}}])) to volume c8442388-fe64-46d2-8835-74c199c40516 successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Temporary image 703fbc9d-c142-441f-a2fb-fc222d705ed5 for user 49e6ee21d903477a9eb6cf8ea77b6dca is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Marking volume c8442388-fe64-46d2-8835-74c199c40516 as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Copying metadata from image 703fbc9d-c142-441f-a2fb-fc222d705ed5 to c8442388-fe64-46d2-8835-74c199c40516. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Creating volume glance metadata for volume c8442388-fe64-46d2-8835-74c199c40516 backed by image 703fbc9d-c142-441f-a2fb-fc222d705ed5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '703fbc9d-c142-441f-a2fb-fc222d705ed5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd510fcdb9b03fe0491768e9ecc1fbc0c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e3e89f-2bae-4d1b-95eb-23d1160c47dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8442388-fe64-46d2-8835-74c199c40516', 'volume_size': 1, 'image_id': '703fbc9d-c142-441f-a2fb-fc222d705ed5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/703fbc9d-c142-441f-a2fb-fc222d705ed5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd510fcdb9b03fe0491768e9ecc1fbc0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e771a0b769443d5ba1ba11ac06ab009', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca5e672f10b1fcd2f255894e62c04fa45e8ae156471f1350cb95b94a7cf9fce4aa3b139855538287290f7334a1ed12787f341b0b8ee9537bda153978a84434f', 'id': '703fbc9d-c142-441f-a2fb-fc222d705ed5', 'created_at': datetime.datetime(2026, 11, 5, 15, 14, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 14, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/703fbc9d-c142-441f-a2fb-fc222d705ed5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4bb8ba-249a-4c37-ab49-bef6d0819106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:00 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Volume volume-c8442388-fe64-46d2-8835-74c199c40516 (c8442388-fe64-46d2-8835-74c199c40516): created successfully Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4bb8ba-249a-4c37-ab49-bef6d0819106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Flow 'volume_create_manager' (76b0f6e5-4587-41ed-a1de-e42c87fad4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:00 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-cad1c8ad-8d9c-4653-9e0c-a2f0e0a39e9f tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Created volume successfully. Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927" returned: 0 in 0.489s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:00 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927 Nov 05 16:15:00 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Acquiring lock "cinder-c8442388-fe64-46d2-8835-74c199c40516-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "cinder-c8442388-fe64-46d2-8835-74c199c40516-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Acquiring lock "cinder-quobyte-c8442388-fe64-46d2-8835-74c199c40516" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:00 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6eff632-ecd0-46ee-87a4-f0bd6a058927" returned: 0 in 0.296s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Lock "cinder-quobyte-c6eff632-ecd0-46ee-87a4-f0bd6a058927" released by "delete_volume" :: held 0.845s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "cinder-quobyte-c8442388-fe64-46d2-8835-74c199c40516" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b369423b-a2d2-4193-9f47-f8497041d913]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Created reservations ['44520278-ee0c-42a5-9923-3a7e68985cd5', '8c16b682-7633-4d3f-830b-f0a7d15affb5', 'e0ee91ce-c7d5-4e1a-8799-1cc0d0223bbf', '62947717-1351-45d8-b91a-760c6ae5543b'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:01 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 Nov 05 16:15:01 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:01 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:01 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:01 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:01 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516" returned: 0 in 0.586s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.411s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Deleted volume successfully. Nov 05 16:15:01 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516 Nov 05 16:15:01 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-971cae99-a5e6-4c70-9cc2-fd97f229b79b tempest-VolumesTestJSON-1550107602 None] Lock "cinder-c6eff632-ecd0-46ee-87a4-f0bd6a058927-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:01 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c8442388-fe64-46d2-8835-74c199c40516" returned: 0 in 0.274s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "cinder-quobyte-c8442388-fe64-46d2-8835-74c199c40516" released by "delete_volume" :: held 0.904s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:01 devstack cinder-volume[86924]: WARNING cinder.quota [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:15:01 devstack cinder-volume[86924]: WARNING cinder.quota [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:15:01 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Created reservations ['6a4ebb47-646a-4763-8294-26f7db80f2c6', 'b07b4ca4-573d-4e89-9bc0-11e936ea1f02', '81e5f68f-f33d-4170-8016-fec8f6bb38af', '2cc3f0ae-9056-482a-8232-3fe2c8f6dffb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:02 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:02 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:02 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.506s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Deleted volume successfully. Nov 05 16:15:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-46bff164-be54-4359-9aa3-f7ae375f2a8e tempest-VolumeAndVolumeTypeFromImageTest-550776518 None] Lock "cinder-c8442388-fe64-46d2-8835-74c199c40516-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Flow 'volume_create_manager' (5be42aad-607d-4db3-919b-076042bc93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abb6908-8370-45d4-8b54-576bd7303d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abb6908-8370-45d4-8b54-576bd7303d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-617941412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4723602d-c307-4dee-b220-4bd0bbd00d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2189664047ad4f1aa4952f5b4b698aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:04Z,use_quota=True,user_id='dad0f0ecfe574a388aae6b705752d4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911cb464-d8d4-4f97-ad16-b045a831ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911cb464-d8d4-4f97-ad16-b045a831ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4d0895-78dc-4b2f-92e0-8fa514fcc9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4d0895-78dc-4b2f-92e0-8fa514fcc9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4723602d-c307-4dee-b220-4bd0bbd00d11', 'volume_name': 'volume-4723602d-c307-4dee-b220-4bd0bbd00d11', 'volume_size': 2}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f1d8d9-78d2-4e63-805d-f989b2f845a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f1d8d9-78d2-4e63-805d-f989b2f845a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916e5900-ab83-4b5a-a981-9b07ed5c274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:04 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Volume 4723602d-c307-4dee-b220-4bd0bbd00d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4723602d-c307-4dee-b220-4bd0bbd00d11', 'volume_size': 2} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-617941412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4723602d-c307-4dee-b220-4bd0bbd00d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2189664047ad4f1aa4952f5b4b698aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:04Z,use_quota=True,user_id='dad0f0ecfe574a388aae6b705752d4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Creating volume 4723602d-c307-4dee-b220-4bd0bbd00d11 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:15:04 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 2147483648 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:04 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 2147483648 Nov 05 16:15:04 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:04 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 2147483648" returned: 0 in 0.679s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:04 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 Nov 05 16:15:04 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:05 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11" returned: 0 in 0.332s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:15:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916e5900-ab83-4b5a-a981-9b07ed5c274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4723602d-c307-4dee-b220-4bd0bbd00d11', 'volume_size': 2}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4943aff8-cdb5-4804-b39d-2a1fa28d5e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:05 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Volume volume-4723602d-c307-4dee-b220-4bd0bbd00d11 (4723602d-c307-4dee-b220-4bd0bbd00d11): created successfully Nov 05 16:15:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4943aff8-cdb5-4804-b39d-2a1fa28d5e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Flow 'volume_create_manager' (5be42aad-607d-4db3-919b-076042bc93ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fb5d72f5-a4f6-4b24-ad6b-261198a1123b tempest-VolumesCloneNegativeTest-890023886 None] Created volume successfully. Nov 05 16:15:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Acquiring lock "cinder-4723602d-c307-4dee-b220-4bd0bbd00d11-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Lock "cinder-4723602d-c307-4dee-b220-4bd0bbd00d11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Acquiring lock "cinder-quobyte-4723602d-c307-4dee-b220-4bd0bbd00d11" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Lock "cinder-quobyte-4723602d-c307-4dee-b220-4bd0bbd00d11" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:06 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[296598fc-37e4-428e-833a-9ac14d23267f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:06 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 Nov 05 16:15:06 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:06 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11" returned: 0 in 0.445s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:07 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11 Nov 05 16:15:07 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:07 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4723602d-c307-4dee-b220-4bd0bbd00d11" returned: 0 in 0.263s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Lock "cinder-quobyte-4723602d-c307-4dee-b220-4bd0bbd00d11" released by "delete_volume" :: held 0.769s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Created reservations ['ccff9964-f4c7-4fa3-894e-be891381ca07', '52b5cbd6-160d-4234-a6e3-a33efd2cb6e1', '7d4f638f-a7ca-40a9-9db0-3fb7d3e85413', '3a0c23ed-8e0e-4471-8eaf-6a661698b522'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:07 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:07 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:07 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.303s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Deleted volume successfully. Nov 05 16:15:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-22d491bd-3d94-447f-876b-332022342bb1 tempest-VolumesCloneNegativeTest-890023886 None] Lock "cinder-4723602d-c307-4dee-b220-4bd0bbd00d11-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Flow 'volume_create_manager' (ec54ab36-5db1-43b2-9148-a7a02cef32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280b4313-4af1-4c13-be24-a54812135aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280b4313-4af1-4c13-be24-a54812135aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1677899446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6270818-2ced-4274-88ad-7445f3e5997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3faf5ab29e0041b986877a3b0e64469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:08Z,use_quota=True,user_id='3f7352c1412b437891b2a946a6c360a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acef644-2063-4a41-bc0f-35ee7fb6b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acef644-2063-4a41-bc0f-35ee7fb6b091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab70c8a9-97ea-49e2-9c8f-01b0a3bafd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab70c8a9-97ea-49e2-9c8f-01b0a3bafd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6270818-2ced-4274-88ad-7445f3e5997f', 'volume_name': 'volume-e6270818-2ced-4274-88ad-7445f3e5997f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c2b5e8-fcb6-42f0-a0cb-e1bd40c82bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c2b5e8-fcb6-42f0-a0cb-e1bd40c82bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3bb013-467c-4b63-8d74-31f1735ace0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:08 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Volume e6270818-2ced-4274-88ad-7445f3e5997f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6270818-2ced-4274-88ad-7445f3e5997f', 'volume_size': 1} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1677899446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6270818-2ced-4274-88ad-7445f3e5997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3faf5ab29e0041b986877a3b0e64469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:08Z,use_quota=True,user_id='3f7352c1412b437891b2a946a6c360a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Creating volume e6270818-2ced-4274-88ad-7445f3e5997f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:15:08 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:15:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:08 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f 1073741824 Nov 05 16:15:08 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:09 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f 1073741824" returned: 0 in 0.595s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:09 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f Nov 05 16:15:09 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:09 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c3bb013-467c-4b63-8d74-31f1735ace0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6270818-2ced-4274-88ad-7445f3e5997f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f4634e-b504-4fb5-8198-124098693158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:09 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Volume volume-e6270818-2ced-4274-88ad-7445f3e5997f (e6270818-2ced-4274-88ad-7445f3e5997f): created successfully Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f4634e-b504-4fb5-8198-124098693158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Flow 'volume_create_manager' (ec54ab36-5db1-43b2-9148-a7a02cef32ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ce3fbd21-9be7-47a7-aa06-2c1ef473f232 tempest-VolumesServicesTestJSON-903499894 None] Created volume successfully. Nov 05 16:15:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Acquiring lock "cinder-e6270818-2ced-4274-88ad-7445f3e5997f-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Lock "cinder-e6270818-2ced-4274-88ad-7445f3e5997f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Acquiring lock "cinder-quobyte-e6270818-2ced-4274-88ad-7445f3e5997f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Lock "cinder-quobyte-e6270818-2ced-4274-88ad-7445f3e5997f" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e996e-a89b-4697-b4e8-6d54339c59ba]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:11 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f Nov 05 16:15:11 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:11 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f" returned: 0 in 0.501s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:11 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f Nov 05 16:15:11 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:11 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e6270818-2ced-4274-88ad-7445f3e5997f" returned: 0 in 0.385s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Lock "cinder-quobyte-e6270818-2ced-4274-88ad-7445f3e5997f" released by "delete_volume" :: held 0.948s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Created reservations ['cc47af44-0047-4c70-b77a-7c1e8e0fdba6', '5879cc69-3662-45ed-9c4e-f5f3c9d37e34', 'e68daaa7-eff7-422a-a934-db01cf3f542a', 'fbf4bb17-4724-4fdc-9624-73bb2690d94f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:11 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:11 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:12 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.357s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:12 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Deleted volume successfully. Nov 05 16:15:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65c93343-ce08-4e36-bf9d-f57760bd423c tempest-VolumesServicesTestJSON-903499894 None] Lock "cinder-e6270818-2ced-4274-88ad-7445f3e5997f-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Flow 'volume_create_manager' (24f07054-4f5b-484f-8a21-e94d60a7e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d5a294-93ae-4150-8626-67fb52d9d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d5a294-93ae-4150-8626-67fb52d9d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-151588667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='435108a7540143d7839433ee0a444277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:14Z,use_quota=True,user_id='887a7985c1df488bbfbdb995f5487dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ec2b43-6c3b-4226-ae19-82a47b772cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ec2b43-6c3b-4226-ae19-82a47b772cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a92150-5b07-45ae-8a92-7c643fcf5ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a92150-5b07-45ae-8a92-7c643fcf5ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8', 'volume_name': 'volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe53aad-07da-4e21-8afd-46f35131f287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe53aad-07da-4e21-8afd-46f35131f287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b2d180-8013-4c88-a7a9-ca8b901b47eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Volume 0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8', 'volume_size': 1} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-151588667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='435108a7540143d7839433ee0a444277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:14Z,use_quota=True,user_id='887a7985c1df488bbfbdb995f5487dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Creating volume 0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:15:13 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:15:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:13 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 1073741824 Nov 05 16:15:13 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:14 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 1073741824" returned: 0 in 0.510s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:14 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 Nov 05 16:15:14 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:14 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8" returned: 0 in 0.331s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b2d180-8013-4c88-a7a9-ca8b901b47eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0323b2-b767-4b38-bc34-de834015d7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:14 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Volume volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 (0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8): created successfully Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0323b2-b767-4b38-bc34-de834015d7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Flow 'volume_create_manager' (24f07054-4f5b-484f-8a21-e94d60a7e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fe25ef7d-e026-46fb-88b9-a91c3cfe353e tempest-VolumesListTestJSON-878883765 None] Created volume successfully. Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Flow 'volume_create_manager' (d4f16c99-6f58-42d0-bd31-a19da264e1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983c9aef-e81e-4001-8c47-a435c50fe81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983c9aef-e81e-4001-8c47-a435c50fe81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2055245548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fbd16f-914c-42de-8ba5-d69cea2ed004,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='435108a7540143d7839433ee0a444277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:16Z,use_quota=True,user_id='887a7985c1df488bbfbdb995f5487dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e1f3f5-0530-4d8c-8be8-6b460abc6797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e1f3f5-0530-4d8c-8be8-6b460abc6797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e88581-77ed-42c4-ad84-2cac63e49ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e88581-77ed-42c4-ad84-2cac63e49ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fbd16f-914c-42de-8ba5-d69cea2ed004', 'volume_name': 'volume-68fbd16f-914c-42de-8ba5-d69cea2ed004', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e4b605-a64d-4912-bda2-640cdbca258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e4b605-a64d-4912-bda2-640cdbca258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2ee25d-99dd-4d61-931b-f5f5d1850a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Volume 68fbd16f-914c-42de-8ba5-d69cea2ed004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fbd16f-914c-42de-8ba5-d69cea2ed004', 'volume_size': 1} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2055245548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fbd16f-914c-42de-8ba5-d69cea2ed004,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='435108a7540143d7839433ee0a444277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:16Z,use_quota=True,user_id='887a7985c1df488bbfbdb995f5487dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Creating volume 68fbd16f-914c-42de-8ba5-d69cea2ed004 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:15:16 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:16 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 1073741824 Nov 05 16:15:16 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:16 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 1073741824" returned: 0 in 0.510s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:16 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 Nov 05 16:15:16 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:17 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:15:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2ee25d-99dd-4d61-931b-f5f5d1850a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fbd16f-914c-42de-8ba5-d69cea2ed004', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a1ce7b-37c2-4d46-9c15-5a6609435b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Volume volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 (68fbd16f-914c-42de-8ba5-d69cea2ed004): created successfully Nov 05 16:15:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a1ce7b-37c2-4d46-9c15-5a6609435b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Flow 'volume_create_manager' (d4f16c99-6f58-42d0-bd31-a19da264e1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8eaa0b07-7ce1-4b98-b440-3c3e69938433 tempest-VolumesListTestJSON-878883765 None] Created volume successfully. Nov 05 16:15:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3146b657-8444-4003-b593-27c425a8dc05 tempest-GroupsV314Test-1216326548 None] Group tempest-GroupsV314Test-Group-1729979194: creating Nov 05 16:15:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3146b657-8444-4003-b593-27c425a8dc05 tempest-GroupsV314Test-1216326548 None] Group tempest-GroupsV314Test-Group-1729979194: created successfully Nov 05 16:15:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3146b657-8444-4003-b593-27c425a8dc05 tempest-GroupsV314Test-1216326548 None] Create group completed successfully. Nov 05 16:15:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:15:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Flow 'volume_create_manager' (d3a11594-da2a-465f-bacf-902ac037c6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ca220b-9120-4164-9854-261260a5c3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ca220b-9120-4164-9854-261260a5c3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2132585758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42378a54-24c7-407a-a168-8b6192c1042f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='435108a7540143d7839433ee0a444277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:19Z,use_quota=True,user_id='887a7985c1df488bbfbdb995f5487dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b85d434-eff6-4bbc-b0fb-c640f97c1abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b85d434-eff6-4bbc-b0fb-c640f97c1abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd9a794-1e71-4066-8b32-bfbb6121320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd9a794-1e71-4066-8b32-bfbb6121320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42378a54-24c7-407a-a168-8b6192c1042f', 'volume_name': 'volume-42378a54-24c7-407a-a168-8b6192c1042f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a822e06-6c43-45ec-8830-eee2388c5fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a822e06-6c43-45ec-8830-eee2388c5fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9787235-6134-416e-988e-60bbe7405ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Volume 42378a54-24c7-407a-a168-8b6192c1042f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42378a54-24c7-407a-a168-8b6192c1042f', 'volume_size': 1} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2132585758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42378a54-24c7-407a-a168-8b6192c1042f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='435108a7540143d7839433ee0a444277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:19Z,use_quota=True,user_id='887a7985c1df488bbfbdb995f5487dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Creating volume 42378a54-24c7-407a-a168-8b6192c1042f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:15:19 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:19 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f 1073741824 Nov 05 16:15:19 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Flow 'volume_create_manager' (dba8bade-8655-44f9-8c97-92623e301fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f6cfa3-3112-4477-8cc0-ddee9ca8380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f6cfa3-3112-4477-8cc0-ddee9ca8380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1280605101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c67d993-4d33-49e4-a4f3-f78385fd5e69,host='devstack@QuobyteHD#QuobyteHD',id=cf36a93f-b465-4e56-ae5f-9c2fdeaf326a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725003f369da4a8cafccfd42e50b9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:19Z,use_quota=True,user_id='5e95365b348b44a8aba3bb023e345a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fb5dd5d-521d-431c-b1da-488a86c50e8b),volume_type_id=4fb5dd5d-521d-431c-b1da-488a86c50e8b)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a9823-1649-4f13-b3ad-14f214543c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399a9823-1649-4f13-b3ad-14f214543c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f18741-a2c0-4514-90c9-2db0f11fd420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f18741-a2c0-4514-90c9-2db0f11fd420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf36a93f-b465-4e56-ae5f-9c2fdeaf326a', 'volume_name': 'volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b88b30-2074-48a9-9a63-2c1169ef9d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b88b30-2074-48a9-9a63-2c1169ef9d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3396fe-c552-4dc1-a0ee-a720407f71fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Volume cf36a93f-b465-4e56-ae5f-9c2fdeaf326a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a', 'volume_size': 1} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:19 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f 1073741824" returned: 0 in 0.521s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:19 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f Nov 05 16:15:19 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:19 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c67d993-4d33-49e4-a4f3-f78385fd5e69,created_at=2026-11-05T15:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1280605101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c67d993-4d33-49e4-a4f3-f78385fd5e69,host='devstack@QuobyteHD#QuobyteHD',id=cf36a93f-b465-4e56-ae5f-9c2fdeaf326a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725003f369da4a8cafccfd42e50b9f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:15:19Z,use_quota=True,user_id='5e95365b348b44a8aba3bb023e345a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fb5dd5d-521d-431c-b1da-488a86c50e8b),volume_type_id=4fb5dd5d-521d-431c-b1da-488a86c50e8b)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Creating volume cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:15:19 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9787235-6134-416e-988e-60bbe7405ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42378a54-24c7-407a-a168-8b6192c1042f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a 1073741824 Nov 05 16:15:19 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21256011-799f-4b43-90cb-2b9f8b97da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Volume volume-42378a54-24c7-407a-a168-8b6192c1042f (42378a54-24c7-407a-a168-8b6192c1042f): created successfully Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21256011-799f-4b43-90cb-2b9f8b97da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Flow 'volume_create_manager' (d3a11594-da2a-465f-bacf-902ac037c6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a3f63c1c-9656-40f5-aa0a-c8126715a0e0 tempest-VolumesListTestJSON-878883765 None] Created volume successfully. Nov 05 16:15:20 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a 1073741824" returned: 0 in 0.572s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:20 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a Nov 05 16:15:20 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:20 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" returned: 0 in 0.263s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3396fe-c552-4dc1-a0ee-a720407f71fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5850bd1-716c-4750-8467-7144334aaf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:15:20 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Volume volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a (cf36a93f-b465-4e56-ae5f-9c2fdeaf326a): created successfully Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5850bd1-716c-4750-8467-7144334aaf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:15:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Flow 'volume_create_manager' (dba8bade-8655-44f9-8c97-92623e301fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:15:20 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-907c3041-d590-45a5-8d44-48df2e07ef1a tempest-GroupsV314Test-1216326548 None] Created volume successfully. Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:22 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Cloning volume cf36a93f-b465-4e56-ae5f-9c2fdeaf326a to volume 85eb2484-6260-4d98-b01a-cfa19d089ae5 Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Creating offline snapshot 836ced57-bbdb-4bb1-9abc-f00cf4bd3cda of volume cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6217efd4-dae2-4eec-aa67-ec1f0cf0e826]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "cinder-42378a54-24c7-407a-a168-8b6192c1042f-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-42378a54-24c7-407a-a168-8b6192c1042f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "cinder-quobyte-42378a54-24c7-407a-a168-8b6192c1042f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:22 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a Nov 05 16:15:22 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-quobyte-42378a54-24c7-407a-a168-8b6192c1042f" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[153df834-fda7-4f42-bf73-f53c802979e6]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:22 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f Nov 05 16:15:22 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:22 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" returned: 0 in 0.438s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:22 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda 1G Nov 05 16:15:22 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:23 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f" returned: 0 in 0.452s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:23 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f Nov 05 16:15:23 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:23 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda 1G" returned: 0 in 0.474s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:23 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda Nov 05 16:15:23 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:23 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-42378a54-24c7-407a-a168-8b6192c1042f" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-quobyte-42378a54-24c7-407a-a168-8b6192c1042f" released by "delete_volume" :: held 0.810s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Created reservations ['caa2f9ba-6f8a-4999-9289-49ccf9134581', 'b71eb889-1c49-4b08-a23c-f35b0ac63c8d', '8372202c-aad5-46c4-b951-3474680cfeea', '20e83176-4ace-4328-898d-c1f3d3d6f811'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:23 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:23 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:23 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" returned: 0 in 0.342s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:23 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:23 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda Nov 05 16:15:23 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:23 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.293s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Deleted volume successfully. Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1e0e5455-d399-455a-be63-58e8feb449c6 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-42378a54-24c7-407a-a168-8b6192c1042f-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:23 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" returned: 0 in 0.281s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "cinder-68fbd16f-914c-42de-8ba5-d69cea2ed004-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-68fbd16f-914c-42de-8ba5-d69cea2ed004-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:24 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.info Nov 05 16:15:24 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "cinder-quobyte-68fbd16f-914c-42de-8ba5-d69cea2ed004" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-quobyte-68fbd16f-914c-42de-8ba5-d69cea2ed004" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1610257-f1eb-43c7-822e-c59cca421fd7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:24 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 Nov 05 16:15:24 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:24 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.info" returned: 0 in 0.294s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:24 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:24 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.info Nov 05 16:15:24 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:24 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004" returned: 0 in 0.433s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:24 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004 Nov 05 16:15:24 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:24 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.info" returned: 0 in 0.292s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Acquiring lock "cinder-quobyte-85eb2484-6260-4d98-b01a-cfa19d089ae5" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-85eb2484-6260-4d98-b01a-cfa19d089ae5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] snapshot: 836ced57-bbdb-4bb1-9abc-f00cf4bd3cda, volume: 85eb2484-6260-4d98-b01a-cfa19d089ae5, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[983a4442-a22c-40c5-9e86-545702ea4481]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:24 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda Nov 05 16:15:24 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:24 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-68fbd16f-914c-42de-8ba5-d69cea2ed004" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-quobyte-68fbd16f-914c-42de-8ba5-d69cea2ed004" released by "delete_volume" :: held 0.779s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Created reservations ['6b59d332-1c80-4c4c-ad1e-271e13c06e5a', 'a6a78b2a-31b6-42de-9837-84eba26c31c0', 'aa31f5fd-f898-40be-8bd1-c5308b0cf2e1', '7323ec1a-5197-473f-8153-9125492a7b06'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:24 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:24 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:25 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" returned: 0 in 0.437s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed6d034-e906-43ce-96c9-2a5c2daa8aaa]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "cinder-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:25 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.335s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Deleted volume successfully. Nov 05 16:15:25 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a Nov 05 16:15:25 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-acf71cc6-8081-46c6-b211-ce95f2dc9707 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-68fbd16f-914c-42de-8ba5-d69cea2ed004-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "cinder-quobyte-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-quobyte-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9f1bca-4464-4c3e-a7da-ea0724873200]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:25 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 Nov 05 16:15:25 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:25 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" returned: 0 in 0.529s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:25 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 Nov 05 16:15:25 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:25 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:25 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8 Nov 05 16:15:25 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:26 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-quobyte-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8" released by "delete_volume" :: held 0.691s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Created reservations ['d72c3488-9a04-486d-b7fb-7fc92f6c3e50', '113b85fc-1680-4f16-8b32-d877fbb5f995', '891951c6-2603-4588-81c8-93038dfc34a7', 'c835693d-c992-4144-9bac-6d2a6eb4241b'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:26 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:26 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:26 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.501s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Deleted volume successfully. Nov 05 16:15:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f7f242c8-b606-4fa0-8f5f-3be56d93dea0 tempest-VolumesListTestJSON-878883765 None] Lock "cinder-0fa5c4e5-ded3-4e0c-9158-4a0cc7aff0d8-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:33 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5" returned: 0 in 7.470s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:15:33 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Converted 1024.00 MB image at 137.07 MB/s Nov 05 16:15:33 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:33 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 Nov 05 16:15:33 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:33 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-85eb2484-6260-4d98-b01a-cfa19d089ae5" released by "_copy_volume_from_snapshot" :: held 8.823s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=116,cinder:UPDATE=146,cinder:INSERT=46,cinder:DELETE=9 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Acquiring lock "cinder-quobyte-836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Deleting offline snapshot 836ced57-bbdb-4bb1-9abc-f00cf4bd3cda of volume cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] snapshot_file for this snap is: volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1be25f-dc46-489c-89cf-15e0a3a553bf]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:33 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda Nov 05 16:15:33 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:33 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:15:34 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cbd571-1808-4993-a78e-a34080f3bfd8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:34 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a Nov 05 16:15:34 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:34 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" returned: 0 in 0.696s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:34 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda Nov 05 16:15:34 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:35 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" returned: 0 in 0.409s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:35 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda Nov 05 16:15:35 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:35 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a.836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" returned: 0 in 0.266s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-836ced57-bbdb-4bb1-9abc-f00cf4bd3cda" released by "_delete_snapshot" :: held 1.936s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.165s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:35 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=171,cinder:INSERT=36,cinder:DELETE=18,cinder:SELECT=124 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:15:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-442e1c0e-2c6a-40c0-9d85-7fbba72d3c67 tempest-GroupsV314Test-1216326548 None] Create group from source-group-7c67d993-4d33-49e4-a4f3-f78385fd5e69 completed successfully. Nov 05 16:15:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Acquiring lock "cinder-quobyte-85eb2484-6260-4d98-b01a-cfa19d089ae5" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-85eb2484-6260-4d98-b01a-cfa19d089ae5" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9523e98-2670-446d-8993-3ad834a3a6aa]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:36 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 Nov 05 16:15:36 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:36 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5" returned: 0 in 0.455s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:36 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5 Nov 05 16:15:36 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:37 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-85eb2484-6260-4d98-b01a-cfa19d089ae5" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-85eb2484-6260-4d98-b01a-cfa19d089ae5" released by "delete_volume" :: held 0.788s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Created reservations ['dc78164f-ff34-4074-ac20-dfe5a07edff4'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:37 devstack cinder-volume[86924]: WARNING cinder.quota [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1561062570 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1561062570, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:15:37 devstack cinder-volume[86924]: WARNING cinder.quota [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1561062570 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1561062570, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Created reservations ['09e2bb2f-287d-4b90-9a47-bcd91bf0c6f8', 'aabf31f1-dee0-41f9-8c67-c1419ca24f90', '1a1df278-bd9e-4190-afaa-3eee21c38c99', 'a45d7169-ddbc-420e-8dce-9b7ccdbb1431'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:37 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:37 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:37 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.348s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c6196045-cf28-4420-83e9-def9681e590f tempest-GroupsV314Test-1216326548 None] Delete group completed successfully. Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Acquiring lock "cinder-quobyte-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:15:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bd546d-e164-404c-ad98-c684541404d0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:38 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a Nov 05 16:15:38 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:38 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" returned: 0 in 0.526s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:38 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a Nov 05 16:15:38 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:38 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" returned: 0 in 0.277s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Lock "cinder-quobyte-cf36a93f-b465-4e56-ae5f-9c2fdeaf326a" released by "delete_volume" :: held 0.893s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Created reservations ['25d499d4-613f-4a14-a7cd-544713bd184e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:38 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Created reservations ['3e939f00-995e-40f0-8558-723680016815', '696514bf-d341-4887-b91d-0ef6bde24e20', '733d8347-b014-47d3-bf4f-2bab2d46f2be', 'f246a5d5-c38d-4467-baff-6dd8b0ad1790'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:39 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:39 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:39 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.424s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:39 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e0797cd7-7598-4415-8d5c-6f24af3bd79a tempest-GroupsV314Test-1216326548 None] Delete group completed successfully. Nov 05 16:15:49 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=24,cinder:SELECT=16,cinder:INSERT=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:15:49 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=23,cinder:SELECT=20,cinder:INSERT=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:15:50 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:15:50 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:15:50 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:15:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Flow 'volume_create_manager' (12e5decb-5a1e-4287-b662-c4b5a538a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c479e908-6fff-4d80-9b6c-e2c4f9f05f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c479e908-6fff-4d80-9b6c-e2c4f9f05f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-210310978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a64141-0846-4d17-a2cb-fa27b4d07a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6c70d95ca4ce992e5b56bac7fec1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:06Z,use_quota=True,user_id='74083e16dffa41d0a4dcb669d7463e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ad6b6f-d18a-4272-8384-018fd8975398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ad6b6f-d18a-4272-8384-018fd8975398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d2955-e2ee-4566-a92c-1ae7dbe3f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:05 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:16:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d2955-e2ee-4566-a92c-1ae7dbe3f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6a64141-0846-4d17-a2cb-fa27b4d07a1b', 'volume_name': 'volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573d012e-f183-4147-baa7-ef1dc9460f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573d012e-f183-4147-baa7-ef1dc9460f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85115b6-080e-47e9-b694-e56fa6c1ed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:06 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Volume c6a64141-0846-4d17-a2cb-fa27b4d07a1b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 16:16:06 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Trying to clone c6a64141-0846-4d17-a2cb-fa27b4d07a1b from image db5f453d-0d67-42b5-9b27-8a3136fce700 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:16:06 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Flow 'volume_create_manager' (c8f09ef9-36bc-4a6a-bdf3-9005815bd300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f2e8d5-b441-4d23-9d4c-31f454981105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f2e8d5-b441-4d23-9d4c-31f454981105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-12941566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bd2e21-1cf8-4fd8-8087-b140295bb324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bababafd8f4a95bb6691b9642eb53c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:07Z,use_quota=True,user_id='720936e2bf624fe8893e42c959e6ff9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7677d6-14af-4ff9-81d7-22dab8b337f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7677d6-14af-4ff9-81d7-22dab8b337f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3db666-78bd-4bb2-9239-482f0a3f377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3db666-78bd-4bb2-9239-482f0a3f377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bd2e21-1cf8-4fd8-8087-b140295bb324', 'volume_name': 'volume-25bd2e21-1cf8-4fd8-8087-b140295bb324', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b570a1b3-98af-4dd8-b23d-1b5dcfced978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b570a1b3-98af-4dd8-b23d-1b5dcfced978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586237e2-b902-468d-8af7-03e7f9fb514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:07 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Volume 25bd2e21-1cf8-4fd8-8087-b140295bb324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bd2e21-1cf8-4fd8-8087-b140295bb324', 'volume_size': 1} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-12941566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bd2e21-1cf8-4fd8-8087-b140295bb324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bababafd8f4a95bb6691b9642eb53c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:07Z,use_quota=True,user_id='720936e2bf624fe8893e42c959e6ff9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Creating volume 25bd2e21-1cf8-4fd8-8087-b140295bb324 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:07 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:07 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 1073741824 Nov 05 16:16:07 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:16:07 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Image download 20.69 MB at 20.69 MB/s Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4ae67-f0b4-45e6-9356-4738feaaef47]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:07 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD Nov 05 16:16:07 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:07 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 is fetched for user 74083e16dffa41d0a4dcb669d7463e76. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:16:07 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 1073741824" returned: 0 in 0.763s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:08 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 Nov 05 16:16:08 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a91aa0-d0e0-47a7-b5ff-33c473fc36db]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:08 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD Nov 05 16:16:08 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:08 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324" returned: 0 in 0.384s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586237e2-b902-468d-8af7-03e7f9fb514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bd2e21-1cf8-4fd8-8087-b140295bb324', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4243ce07-eb6b-4f70-b6d1-d38378c857a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:08 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Volume volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 (25bd2e21-1cf8-4fd8-8087-b140295bb324): created successfully Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4243ce07-eb6b-4f70-b6d1-d38378c857a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Flow 'volume_create_manager' (c8f09ef9-36bc-4a6a-bdf3-9005815bd300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:08 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a1e7ca2c-adfe-4033-bd35-51b643f7c7bc tempest-VolumeQuotasAdminTestJSON-1179445822 None] Created volume successfully. Nov 05 16:16:08 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-210310978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a64141-0846-4d17-a2cb-fa27b4d07a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b6c70d95ca4ce992e5b56bac7fec1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:06Z,use_quota=True,user_id='74083e16dffa41d0a4dcb669d7463e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Creating volume c6a64141-0846-4d17-a2cb-fa27b4d07a1b {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:08 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:08 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b 1073741824 Nov 05 16:16:08 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Acquiring lock "cinder-25bd2e21-1cf8-4fd8-8087-b140295bb324-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "cinder-25bd2e21-1cf8-4fd8-8087-b140295bb324-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Acquiring lock "cinder-quobyte-25bd2e21-1cf8-4fd8-8087-b140295bb324" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "cinder-quobyte-25bd2e21-1cf8-4fd8-8087-b140295bb324" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd0f52e-fcdf-4c30-abe8-e1868281a836]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:08 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 Nov 05 16:16:08 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:09 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b 1073741824" returned: 0 in 0.563s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:09 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b Nov 05 16:16:09 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:09 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:09 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324 Nov 05 16:16:09 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:09 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b" returned: 0 in 0.327s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Attempting download of db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume c6a64141-0846-4d17-a2cb-fa27b4d07a1b. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:16:09 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25bd2e21-1cf8-4fd8-8087-b140295bb324" returned: 0 in 0.326s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "cinder-quobyte-25bd2e21-1cf8-4fd8-8087-b140295bb324" released by "delete_volume" :: held 0.819s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1da263-78ff-4d2d-9195-d382ca9d247e]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_xaudhrum {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Created reservations ['b2d4961a-b6ef-4b75-a563-ebdbb503153b', '4d41e991-7403-46e8-8773-97f5a64df760', '4181e5f3-66d5-49a6-b5c1-98493c3d9711', '1b68b4c5-8f70-471e-86bd-cdc2f1f3620e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:09 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_xaudhrum Nov 05 16:16:09 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:09 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:09 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:10 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_xaudhrum" returned: 0 in 0.436s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_xaudhrum {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:10 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.427s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:10 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Deleted volume successfully. Nov 05 16:16:10 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_xaudhrum Nov 05 16:16:10 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a4ad5f2b-28ea-4e8e-a708-5294bfc81bb0 tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "cinder-25bd2e21-1cf8-4fd8-8087-b140295bb324-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (6131ae00-c14b-4862-9e86-fee447008c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825ac17c-a70a-4c3e-a275-4e7fb820e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825ac17c-a70a-4c3e-a275-4e7fb820e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2087370089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b6d03c-8504-4eb2-8245-fa1f405d1b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:11Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5691ab-b11c-42be-af98-1ec2704bb807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:10 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5691ab-b11c-42be-af98-1ec2704bb807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737cc2b5-e123-4c78-80fc-9a874ca452d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737cc2b5-e123-4c78-80fc-9a874ca452d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b6d03c-8504-4eb2-8245-fa1f405d1b92', 'volume_name': 'volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9951587-9795-4e3f-8662-10eb866ab970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9951587-9795-4e3f-8662-10eb866ab970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb4cc9b-f1a2-4b09-980f-6c525d8cde5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:10 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Volume 76b6d03c-8504-4eb2-8245-fa1f405d1b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92', 'volume_size': 1} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2087370089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b6d03c-8504-4eb2-8245-fa1f405d1b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:11Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Creating volume 76b6d03c-8504-4eb2-8245-fa1f405d1b92 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:10 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_xaudhrum" returned: 1 in 0.738s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700_xaudhrum' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a96790e-36e3-478e-b262-2a1714b7bfb5]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:10 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 1073741824 Nov 05 16:16:10 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:11 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD Nov 05 16:16:11 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Flow 'volume_create_manager' (3767b4f5-58c3-453d-bc4e-fa6b5b54a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0431b39f-ca70-431f-a1aa-532fbb9ed388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0431b39f-ca70-431f-a1aa-532fbb9ed388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1132589942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bff6bb-76e1-40c5-9c52-df45e51e746f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bababafd8f4a95bb6691b9642eb53c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:11Z,use_quota=True,user_id='720936e2bf624fe8893e42c959e6ff9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374b17c8-90e5-4ca9-9f16-de97fe8108b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374b17c8-90e5-4ca9-9f16-de97fe8108b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b447f25d-9667-435c-9b17-8e1dde276949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b447f25d-9667-435c-9b17-8e1dde276949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17bff6bb-76e1-40c5-9c52-df45e51e746f', 'volume_name': 'volume-17bff6bb-76e1-40c5-9c52-df45e51e746f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f79e72-b09d-4f43-862d-91708f31fe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f79e72-b09d-4f43-862d-91708f31fe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff749d38-adc3-4ada-b4bc-0975760a4c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:11 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Volume 17bff6bb-76e1-40c5-9c52-df45e51e746f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17bff6bb-76e1-40c5-9c52-df45e51e746f', 'volume_size': 1} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:11 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] db5f453d-0d67-42b5-9b27-8a3136fce700 was qcow2, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:11 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 1073741824" returned: 0 in 0.479s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:11 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b Nov 05 16:16:11 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:11 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 Nov 05 16:16:11 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:11 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92" returned: 0 in 0.290s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1132589942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bff6bb-76e1-40c5-9c52-df45e51e746f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bababafd8f4a95bb6691b9642eb53c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:11Z,use_quota=True,user_id='720936e2bf624fe8893e42c959e6ff9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Creating volume 17bff6bb-76e1-40c5-9c52-df45e51e746f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:11 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb4cc9b-f1a2-4b09-980f-6c525d8cde5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8464d9c-ab5b-4e84-8f6b-973df82a8ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:11 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f 1073741824 Nov 05 16:16:11 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:11 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Volume volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 (76b6d03c-8504-4eb2-8245-fa1f405d1b92): created successfully Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8464d9c-ab5b-4e84-8f6b-973df82a8ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (6131ae00-c14b-4862-9e86-fee447008c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-beffcad7-9784-4a21-b646-affdf28a0501 tempest-VolumesActionsTest-1734994595 None] Created volume successfully. Nov 05 16:16:12 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f 1073741824" returned: 0 in 0.651s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:12 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f Nov 05 16:16:12 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:12 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f" returned: 0 in 0.372s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff749d38-adc3-4ada-b4bc-0975760a4c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17bff6bb-76e1-40c5-9c52-df45e51e746f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b40a22-d76b-4879-9f7d-0fff94dd8ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:12 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Volume volume-17bff6bb-76e1-40c5-9c52-df45e51e746f (17bff6bb-76e1-40c5-9c52-df45e51e746f): created successfully Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b40a22-d76b-4879-9f7d-0fff94dd8ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Flow 'volume_create_manager' (3767b4f5-58c3-453d-bc4e-fa6b5b54a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-463538ca-85f5-4d19-9b1d-02f05b631a4b tempest-VolumeQuotasAdminTestJSON-1179445822 None] Created volume successfully. Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5f970b8-64aa-46c8-8195-43233556d18e tempest-VolumesActionsTest-1734994595 None] Acquiring lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92" by "attach_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5f970b8-64aa-46c8-8195-43233556d18e tempest-VolumesActionsTest-1734994595 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92" acquired by "attach_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f5f970b8-64aa-46c8-8195-43233556d18e tempest-VolumesActionsTest-1734994595 None] Attaching volume 76b6d03c-8504-4eb2-8245-fa1f405d1b92 to instance 08b9e66f-c63c-4675-a6cd-8b4f9efae616 at mountpoint /dev/vdb on host None. Nov 05 16:16:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f5f970b8-64aa-46c8-8195-43233556d18e tempest-VolumesActionsTest-1734994595 None] Attach volume completed successfully. Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f5f970b8-64aa-46c8-8195-43233556d18e tempest-VolumesActionsTest-1734994595 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92" released by "attach_volume" :: held 0.135s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:13 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b" returned: 0 in 2.165s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_s9vvtiondevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:16:13 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Converted 112.00 MB image at 51.72 MB/s Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:13 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b 1G Nov 05 16:16:13 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:13 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b 1G" returned: 0 in 0.463s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Downloaded image db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume c6a64141-0846-4d17-a2cb-fa27b4d07a1b successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 for user 74083e16dffa41d0a4dcb669d7463e76 is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Marking volume c6a64141-0846-4d17-a2cb-fa27b4d07a1b as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Copying metadata from image db5f453d-0d67-42b5-9b27-8a3136fce700 to c6a64141-0846-4d17-a2cb-fa27b4d07a1b. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:16:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Creating volume glance metadata for volume c6a64141-0846-4d17-a2cb-fa27b4d07a1b backed by image db5f453d-0d67-42b5-9b27-8a3136fce700 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:16:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4e55c5dc-240b-4779-9058-2003ee07dedb tempest-VolumeQuotasAdminTestJSON-1975293173 None] Transfer volume completed successfully. Nov 05 16:16:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bfbdf27c-5dad-4f2d-8580-597b45f5f6c6 tempest-VolumesActionsTest-1711504469 None] Terminate volume connection completed successfully. Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfbdf27c-5dad-4f2d-8580-597b45f5f6c6 tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-detach_volume" by "detach_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85115b6-080e-47e9-b694-e56fa6c1ed44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b01dc2b-5d45-47d8-84d2-321df28fcfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfbdf27c-5dad-4f2d-8580-597b45f5f6c6 tempest-VolumesActionsTest-1711504469 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:14 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Volume volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b (c6a64141-0846-4d17-a2cb-fa27b4d07a1b): created successfully Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b01dc2b-5d45-47d8-84d2-321df28fcfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Flow 'volume_create_manager' (12e5decb-5a1e-4287-b662-c4b5a538a970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bfbdf27c-5dad-4f2d-8580-597b45f5f6c6 tempest-VolumesActionsTest-1711504469 None] Detaching volume 76b6d03c-8504-4eb2-8245-fa1f405d1b92 from instance 08b9e66f-c63c-4675-a6cd-8b4f9efae616. Nov 05 16:16:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-94e14fab-e7e5-4dc1-9111-8e2f02003fa5 tempest-TestShelveInstance-1737909259 None] Created volume successfully. Nov 05 16:16:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bfbdf27c-5dad-4f2d-8580-597b45f5f6c6 tempest-VolumesActionsTest-1711504469 None] Detach volume completed successfully. Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bfbdf27c-5dad-4f2d-8580-597b45f5f6c6 tempest-VolumesActionsTest-1711504469 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-905e63fb-f9b4-4adc-a9e3-7aa3caa736dc tempest-VolumesActionsTest-1734994595 None] Acquiring lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-detach_volume" by "detach_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-905e63fb-f9b4-4adc-a9e3-7aa3caa736dc tempest-VolumesActionsTest-1734994595 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-905e63fb-f9b4-4adc-a9e3-7aa3caa736dc tempest-VolumesActionsTest-1734994595 None] Volume detach called, but volume not attached. Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-905e63fb-f9b4-4adc-a9e3-7aa3caa736dc tempest-VolumesActionsTest-1734994595 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-detach_volume" released by "detach_volume" :: held 0.017s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Acquiring lock "cinder-17bff6bb-76e1-40c5-9c52-df45e51e746f-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Lock "cinder-17bff6bb-76e1-40c5-9c52-df45e51e746f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Acquiring lock "cinder-quobyte-17bff6bb-76e1-40c5-9c52-df45e51e746f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Lock "cinder-quobyte-17bff6bb-76e1-40c5-9c52-df45e51e746f" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1154c646-8002-4e04-9716-16f991feeb7f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "cinder-quobyte-76b6d03c-8504-4eb2-8245-fa1f405d1b92" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:14 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f Nov 05 16:16:14 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Lock "cinder-quobyte-76b6d03c-8504-4eb2-8245-fa1f405d1b92" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0770e317-f439-4716-8ff6-0180861e6208]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:14 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 Nov 05 16:16:14 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:15 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f" returned: 0 in 0.453s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:15 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f Nov 05 16:16:15 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:15 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92" returned: 0 in 0.437s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:15 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92 Nov 05 16:16:15 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:15 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bff6bb-76e1-40c5-9c52-df45e51e746f" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Lock "cinder-quobyte-17bff6bb-76e1-40c5-9c52-df45e51e746f" released by "delete_volume" :: held 0.808s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Created reservations ['ffb07a35-7842-4d3a-8588-ff1e908d9588', 'b3e546aa-718a-41c0-bc28-8e305682f07a', '9d73fb07-04c5-41e5-a3fb-47e1dd07c649', '99570c90-629c-4b8b-b43f-d9fcedb5e597'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:15 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-76b6d03c-8504-4eb2-8245-fa1f405d1b92" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Lock "cinder-quobyte-76b6d03c-8504-4eb2-8245-fa1f405d1b92" released by "delete_volume" :: held 0.783s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:15 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:15 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Created reservations ['f35a2dc5-fccc-4d59-a6da-40b49e8edf04', '7b84b81c-3263-45d5-988f-15f1e7c335d2', '553598b1-bd02-4dab-af35-f62fbe142ff7', '3d0c6365-a788-4aab-bc08-4ea99afb2ebf'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:16 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:16 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:16 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.531s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:16 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Deleted volume successfully. Nov 05 16:16:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b97d2e47-b0b3-487c-a240-3750eb788c45 tempest-VolumeQuotasAdminTestJSON-264525397 None] Lock "cinder-17bff6bb-76e1-40c5-9c52-df45e51e746f-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:16 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:16 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Deleted volume successfully. Nov 05 16:16:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8d8d130-0f48-4be2-b9db-04f26a4dd600 tempest-VolumesActionsTest-1734994595 None] Lock "cinder-76b6d03c-8504-4eb2-8245-fa1f405d1b92-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-a98650f6-ae51-47be-97a3-38c38b548782 req-c0c71253-c360-4826-b438-661b8e5e73ae tempest-TestShelveInstance-1737909259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-a98650f6-ae51-47be-97a3-38c38b548782 req-c0c71253-c360-4826-b438-661b8e5e73ae tempest-TestShelveInstance-1737909259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-a98650f6-ae51-47be-97a3-38c38b548782 req-c0c71253-c360-4826-b438-661b8e5e73ae tempest-TestShelveInstance-1737909259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-a98650f6-ae51-47be-97a3-38c38b548782 req-c0c71253-c360-4826-b438-661b8e5e73ae tempest-TestShelveInstance-1737909259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67c0b37c-9ec0-4e13-9507-214f6a82eba4', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:16:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-a98650f6-ae51-47be-97a3-38c38b548782 req-c0c71253-c360-4826-b438-661b8e5e73ae tempest-TestShelveInstance-1737909259 None] attachment_update completed successfully. Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (f0737b81-6239-484d-8181-d3f011ee9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21646e3c-c5ea-4582-9257-e943bbcf2ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21646e3c-c5ea-4582-9257-e943bbcf2ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2063229865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54c2369-513e-47e3-bef3-ce77bea35e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:21Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cfdc7b-80f9-4136-b55d-21cfdcff52ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cfdc7b-80f9-4136-b55d-21cfdcff52ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b070c8-3c9b-45d3-96ae-5377ccd7e544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b070c8-3c9b-45d3-96ae-5377ccd7e544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54c2369-513e-47e3-bef3-ce77bea35e06', 'volume_name': 'volume-a54c2369-513e-47e3-bef3-ce77bea35e06', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c736744e-e4a0-48f3-87f9-a53254f30a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c736744e-e4a0-48f3-87f9-a53254f30a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2695397b-0c11-47ad-b42f-c9d2eea26ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:20 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Volume a54c2369-513e-47e3-bef3-ce77bea35e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54c2369-513e-47e3-bef3-ce77bea35e06', 'volume_size': 1} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2063229865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54c2369-513e-47e3-bef3-ce77bea35e06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:21Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Creating volume a54c2369-513e-47e3-bef3-ce77bea35e06 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:20 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:20 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 1073741824 Nov 05 16:16:20 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:21 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 1073741824" returned: 0 in 0.529s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:21 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 Nov 05 16:16:21 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:21 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2695397b-0c11-47ad-b42f-c9d2eea26ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54c2369-513e-47e3-bef3-ce77bea35e06', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cbde0b-1a7f-4adf-8822-ce36a0136388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:21 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Volume volume-a54c2369-513e-47e3-bef3-ce77bea35e06 (a54c2369-513e-47e3-bef3-ce77bea35e06): created successfully Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cbde0b-1a7f-4adf-8822-ce36a0136388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (f0737b81-6239-484d-8181-d3f011ee9eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-735ab0e1-4232-469a-a679-fa9b6bb31e35 tempest-VolumesActionsTest-1734994595 None] Created volume successfully. Nov 05 16:16:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-a54c2369-513e-47e3-bef3-ce77bea35e06-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Lock "cinder-a54c2369-513e-47e3-bef3-ce77bea35e06-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-quobyte-a54c2369-513e-47e3-bef3-ce77bea35e06" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-a54c2369-513e-47e3-bef3-ce77bea35e06" acquired by "delete_volume" :: waited 0.038s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03173d1d-6ec3-4f87-96c3-b7c29c9ce516]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:23 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 Nov 05 16:16:23 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:23 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06" returned: 0 in 0.532s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:23 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06 Nov 05 16:16:23 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:23 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a54c2369-513e-47e3-bef3-ce77bea35e06" returned: 0 in 0.281s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-a54c2369-513e-47e3-bef3-ce77bea35e06" released by "delete_volume" :: held 0.894s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:23 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Created reservations ['23a3cd95-56d7-43d9-b4c4-816a60336df1', '59609803-b03c-4ff7-beb9-3996d6fed0e6', 'b66116e8-79b3-42c8-a713-bef0ea3da944', '16d5c6da-a837-4962-bb94-a044d1bcd248'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:24 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:24 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:24 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.448s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:24 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Deleted volume successfully. Nov 05 16:16:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb368312-0ea9-4498-9a6b-0c38b83ae1fa tempest-VolumesActionsTest-1711504469 None] Lock "cinder-a54c2369-513e-47e3-bef3-ce77bea35e06-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (1f7d7826-1271-4d36-97c0-10fe756182f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dfb932-5fcf-446b-a182-6b86064e01d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dfb932-5fcf-446b-a182-6b86064e01d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309174882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756009f8-8155-4570-abed-b797ee3b87ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:25Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a579be-488d-4fe4-bbcd-c6da3da10b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a579be-488d-4fe4-bbcd-c6da3da10b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5343b05f-8e69-4647-9694-d573f8026e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5343b05f-8e69-4647-9694-d573f8026e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756009f8-8155-4570-abed-b797ee3b87ce', 'volume_name': 'volume-756009f8-8155-4570-abed-b797ee3b87ce', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8226bd82-ef73-4de0-af9f-87db5f890e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8226bd82-ef73-4de0-af9f-87db5f890e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb12d3b-92b8-48cf-899c-3453483ee75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:25 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Volume 756009f8-8155-4570-abed-b797ee3b87ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756009f8-8155-4570-abed-b797ee3b87ce', 'volume_size': 1} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309174882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756009f8-8155-4570-abed-b797ee3b87ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:25Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Creating volume 756009f8-8155-4570-abed-b797ee3b87ce {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:25 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:25 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce 1073741824 Nov 05 16:16:25 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:25 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce 1073741824" returned: 0 in 0.668s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:25 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce Nov 05 16:16:25 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:26 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb12d3b-92b8-48cf-899c-3453483ee75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756009f8-8155-4570-abed-b797ee3b87ce', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cf344e-c40b-43f2-852f-09cc70e43fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:26 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Volume volume-756009f8-8155-4570-abed-b797ee3b87ce (756009f8-8155-4570-abed-b797ee3b87ce): created successfully Nov 05 16:16:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cf344e-c40b-43f2-852f-09cc70e43fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (1f7d7826-1271-4d36-97c0-10fe756182f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fdb4ba5b-4f48-46ce-93ba-6993af2517f0 tempest-VolumesActionsTest-1734994595 None] Created volume successfully. Nov 05 16:16:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-756009f8-8155-4570-abed-b797ee3b87ce-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Lock "cinder-756009f8-8155-4570-abed-b797ee3b87ce-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-quobyte-756009f8-8155-4570-abed-b797ee3b87ce" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-756009f8-8155-4570-abed-b797ee3b87ce" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda82f04-5eaa-408b-acb2-949ec43cff15]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:27 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce Nov 05 16:16:27 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:28 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce" returned: 0 in 0.563s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:28 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce Nov 05 16:16:28 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:28 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-756009f8-8155-4570-abed-b797ee3b87ce" returned: 0 in 0.420s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-756009f8-8155-4570-abed-b797ee3b87ce" released by "delete_volume" :: held 1.081s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Created reservations ['1c7e61e4-dac1-498c-8cc5-3cf4652c2ec1', 'f682e973-3e09-48ac-a5a8-98bd5cf24885', 'ba8839c0-d5c8-4698-bb5b-3ac9fe0e5b54', 'caf870ff-5c93-4b3f-95f3-4a7359e2faf0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:28 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:28 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:29 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.429s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:29 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Deleted volume successfully. Nov 05 16:16:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5320ae2-248b-4915-b0f4-6fd62a9478b2 tempest-VolumesActionsTest-1711504469 None] Lock "cinder-756009f8-8155-4570-abed-b797ee3b87ce-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (eb301a03-40c8-4a7f-9aae-389ce9a6c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ebadc7-13cf-40fe-9619-1938148fcf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ebadc7-13cf-40fe-9619-1938148fcf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-113025296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92ec8e7-24bf-4343-a1ef-e74f987073bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:30Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e610b535-d5ca-40b3-bd67-40673634b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e610b535-d5ca-40b3-bd67-40673634b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219c3140-8de9-46fd-b164-397388f8d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219c3140-8de9-46fd-b164-397388f8d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92ec8e7-24bf-4343-a1ef-e74f987073bb', 'volume_name': 'volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5420edd7-32cb-4e5d-bd95-ceea7729da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5420edd7-32cb-4e5d-bd95-ceea7729da8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca4de73-066a-45a5-8177-5432c8de0c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Volume c92ec8e7-24bf-4343-a1ef-e74f987073bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb', 'volume_size': 1} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-113025296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92ec8e7-24bf-4343-a1ef-e74f987073bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:30Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Creating volume c92ec8e7-24bf-4343-a1ef-e74f987073bb {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:30 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:30 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb 1073741824 Nov 05 16:16:30 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:30 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb 1073741824" returned: 0 in 0.450s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:31 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb Nov 05 16:16:31 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:31 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca4de73-066a-45a5-8177-5432c8de0c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fff2653-fb55-4612-88bd-d2671c14b4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Volume volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb (c92ec8e7-24bf-4343-a1ef-e74f987073bb): created successfully Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fff2653-fb55-4612-88bd-d2671c14b4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (eb301a03-40c8-4a7f-9aae-389ce9a6c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:31 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a4082402-4fb0-47bb-8f5f-d56fc41b2699 tempest-VolumesActionsTest-1734994595 None] Created volume successfully. Nov 05 16:16:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-c92ec8e7-24bf-4343-a1ef-e74f987073bb-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Lock "cinder-c92ec8e7-24bf-4343-a1ef-e74f987073bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-quobyte-c92ec8e7-24bf-4343-a1ef-e74f987073bb" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-c92ec8e7-24bf-4343-a1ef-e74f987073bb" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:32 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[935926bc-8c4b-44e3-aeac-574d36387c54]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:32 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb Nov 05 16:16:32 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:33 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb" returned: 0 in 0.398s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:33 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb Nov 05 16:16:33 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:33 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c92ec8e7-24bf-4343-a1ef-e74f987073bb" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-c92ec8e7-24bf-4343-a1ef-e74f987073bb" released by "delete_volume" :: held 0.717s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Created reservations ['50c97bad-da4c-42e3-8a04-b83d9f0ed68f', 'b048a837-b47c-45d8-b7d4-4a296a81004a', '271ef626-d7b3-4f53-82ed-b81d43db69d0', 'd247ad3d-1f14-489d-b528-84915de3cec5'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:33 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:33 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:33 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.329s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Deleted volume successfully. Nov 05 16:16:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4a835f6e-a0bf-4808-8044-9cdf0b7d1d8a tempest-VolumesActionsTest-1711504469 None] Lock "cinder-c92ec8e7-24bf-4343-a1ef-e74f987073bb-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (698133e9-7487-457b-a714-667e4d9f2289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2bde23-8d80-443d-9bdd-6683e8d8aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2bde23-8d80-443d-9bdd-6683e8d8aa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345208526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a17c05a-1290-47f4-a06a-7697c2c8e621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:34Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab18401-d5ed-47a2-964c-07ddbf41e669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab18401-d5ed-47a2-964c-07ddbf41e669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0903275-e2c2-4fa7-b4c3-83d892eb3806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0903275-e2c2-4fa7-b4c3-83d892eb3806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a17c05a-1290-47f4-a06a-7697c2c8e621', 'volume_name': 'volume-3a17c05a-1290-47f4-a06a-7697c2c8e621', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04748e0a-6421-4107-936c-423c3b36f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04748e0a-6421-4107-936c-423c3b36f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb8075b-2be4-4a8a-a5ae-6cebd187a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:34 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Volume 3a17c05a-1290-47f4-a06a-7697c2c8e621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a17c05a-1290-47f4-a06a-7697c2c8e621', 'volume_size': 1} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1345208526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a17c05a-1290-47f4-a06a-7697c2c8e621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:34Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Creating volume 3a17c05a-1290-47f4-a06a-7697c2c8e621 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:34 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:34 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 1073741824 Nov 05 16:16:34 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:35 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 1073741824" returned: 0 in 0.545s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:35 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 Nov 05 16:16:35 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:35 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621" returned: 0 in 0.355s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb8075b-2be4-4a8a-a5ae-6cebd187a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a17c05a-1290-47f4-a06a-7697c2c8e621', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8854bd-3564-4871-a164-12f8ab71104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:35 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Volume volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 (3a17c05a-1290-47f4-a06a-7697c2c8e621): created successfully Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8854bd-3564-4871-a164-12f8ab71104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (698133e9-7487-457b-a714-667e4d9f2289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6999fffb-a81c-4c12-8dba-1cb95cdad6b8 tempest-VolumesActionsTest-1734994595 None] Created volume successfully. Nov 05 16:16:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-3a17c05a-1290-47f4-a06a-7697c2c8e621-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Lock "cinder-3a17c05a-1290-47f4-a06a-7697c2c8e621-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Acquiring lock "cinder-quobyte-3a17c05a-1290-47f4-a06a-7697c2c8e621" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-3a17c05a-1290-47f4-a06a-7697c2c8e621" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[777a4aee-731c-450d-ae9a-daf642ba106b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:36 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 Nov 05 16:16:36 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:37 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:37 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621 Nov 05 16:16:37 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:37 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3a17c05a-1290-47f4-a06a-7697c2c8e621" returned: 0 in 0.278s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Lock "cinder-quobyte-3a17c05a-1290-47f4-a06a-7697c2c8e621" released by "delete_volume" :: held 0.732s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Created reservations ['ebcab1eb-3589-4fc5-b39f-5d3ead4491d9', 'd4fb6b9a-5b67-471c-9663-cdd846e1ff7e', '5cb822c0-02cb-4def-ab83-1b3e008d41c5', '2c893215-a3d5-487a-926f-1fd983f64862'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:37 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:37 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:37 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.287s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Deleted volume successfully. Nov 05 16:16:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-dddf5faa-cd70-4816-aa64-a42415dba54f tempest-VolumesActionsTest-1711504469 None] Lock "cinder-3a17c05a-1290-47f4-a06a-7697c2c8e621-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (6999f8b8-946e-42e2-929f-1479055cc8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1197a750-b89d-40b9-86c3-5a7259519c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1197a750-b89d-40b9-86c3-5a7259519c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-432709006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419f79ae-1c24-41d2-87ee-07fad8a63c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:38Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e21aba-d676-41db-985e-220b683cdda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e21aba-d676-41db-985e-220b683cdda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3290148d-3a99-41f5-b9fe-c3e6efa14c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3290148d-3a99-41f5-b9fe-c3e6efa14c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419f79ae-1c24-41d2-87ee-07fad8a63c33', 'volume_name': 'volume-419f79ae-1c24-41d2-87ee-07fad8a63c33', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3894df3-0ddc-42b3-9e7a-428ce1870b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3894df3-0ddc-42b3-9e7a-428ce1870b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03dca51f-5a4f-4d4b-8fca-ba70f59d3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Volume 419f79ae-1c24-41d2-87ee-07fad8a63c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419f79ae-1c24-41d2-87ee-07fad8a63c33', 'volume_size': 1} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-432709006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419f79ae-1c24-41d2-87ee-07fad8a63c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27453a47e5c4663ae997083ee1f2504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:38Z,use_quota=True,user_id='c70d30854aa04490929a72c74724ebf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Creating volume 419f79ae-1c24-41d2-87ee-07fad8a63c33 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:38 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:38 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 1073741824 Nov 05 16:16:38 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:39 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 1073741824" returned: 0 in 0.476s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:39 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 Nov 05 16:16:39 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:39 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33" returned: 0 in 0.313s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03dca51f-5a4f-4d4b-8fca-ba70f59d3d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419f79ae-1c24-41d2-87ee-07fad8a63c33', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae930a3-19ab-4d58-bed9-000feb6175b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Volume volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 (419f79ae-1c24-41d2-87ee-07fad8a63c33): created successfully Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae930a3-19ab-4d58-bed9-000feb6175b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Flow 'volume_create_manager' (6999f8b8-946e-42e2-929f-1479055cc8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9d2a1c8c-0fe1-4515-8784-0565bf8e4d8f tempest-VolumesActionsTest-1734994595 None] Created volume successfully. Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Acquiring lock "cinder-419f79ae-1c24-41d2-87ee-07fad8a63c33-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Lock "cinder-419f79ae-1c24-41d2-87ee-07fad8a63c33-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Acquiring lock "cinder-quobyte-419f79ae-1c24-41d2-87ee-07fad8a63c33" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Lock "cinder-quobyte-419f79ae-1c24-41d2-87ee-07fad8a63c33" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[005dce07-fcfe-4095-bb14-f53d5480b88f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:41 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 Nov 05 16:16:41 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:41 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33" returned: 0 in 0.420s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:41 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33 Nov 05 16:16:41 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:42 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-419f79ae-1c24-41d2-87ee-07fad8a63c33" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Lock "cinder-quobyte-419f79ae-1c24-41d2-87ee-07fad8a63c33" released by "delete_volume" :: held 0.755s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Created reservations ['b07c2640-f7c7-4937-80be-f72d98f2a532', '9f3818e9-077f-41a2-a514-d50ab61d0e4d', '6540f550-8f2a-49e7-b700-c85660367998', '0ba5c69c-8868-4618-a774-1753bf7b5b77'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:42 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:42 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:42 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.287s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Deleted volume successfully. Nov 05 16:16:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1787382-3a5d-4778-87dd-ebacdb7d482f tempest-VolumesActionsTest-1734994595 None] Lock "cinder-419f79ae-1c24-41d2-87ee-07fad8a63c33-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:50 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:50 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:50 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:16:50 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Flow 'volume_create_manager' (6ac3df68-6c83-4dca-8170-0c704c877cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b13252-85b5-4de4-8c67-c28dda28bb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b13252-85b5-4de4-8c67-c28dda28bb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-733670766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eed0405-7908-48ea-bb4e-c598148d75f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baae7bf6f5ef46c4811f9e240dab7448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:51Z,use_quota=True,user_id='0916a9050ba14e5e918e878890d0847b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0758c40b-9549-48b1-9b57-dbbdfe3d741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0758c40b-9549-48b1-9b57-dbbdfe3d741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0434c6a-bffe-4822-8ca3-e61a5a27e944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0434c6a-bffe-4822-8ca3-e61a5a27e944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eed0405-7908-48ea-bb4e-c598148d75f8', 'volume_name': 'volume-9eed0405-7908-48ea-bb4e-c598148d75f8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e99743-f69f-4363-bb1c-e951fe62c013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e99743-f69f-4363-bb1c-e951fe62c013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b10ca7-e190-413e-b9e7-b78a7d39da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:51 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Volume 9eed0405-7908-48ea-bb4e-c598148d75f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eed0405-7908-48ea-bb4e-c598148d75f8', 'volume_size': 1} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-733670766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eed0405-7908-48ea-bb4e-c598148d75f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baae7bf6f5ef46c4811f9e240dab7448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:51Z,use_quota=True,user_id='0916a9050ba14e5e918e878890d0847b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Creating volume 9eed0405-7908-48ea-bb4e-c598148d75f8 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:51 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:51 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 1073741824 Nov 05 16:16:51 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:51 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 1073741824" returned: 0 in 0.571s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:51 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 Nov 05 16:16:51 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:51 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8" returned: 0 in 0.282s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b10ca7-e190-413e-b9e7-b78a7d39da46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eed0405-7908-48ea-bb4e-c598148d75f8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4823ff72-1c60-4295-81d2-9692fc43aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:52 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Volume volume-9eed0405-7908-48ea-bb4e-c598148d75f8 (9eed0405-7908-48ea-bb4e-c598148d75f8): created successfully Nov 05 16:16:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4823ff72-1c60-4295-81d2-9692fc43aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Flow 'volume_create_manager' (6ac3df68-6c83-4dca-8170-0c704c877cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:52 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e444c473-7626-43d8-8dbe-b55eeaa26599 tempest-VolumesTransfersV355Test-1621829410 None] Created volume successfully. Nov 05 16:16:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9c6fc91e-9b53-433b-bc68-c541e1ffee67 tempest-VolumesTransfersV355Test-655341535 None] Transfer volume completed successfully. Nov 05 16:16:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Acquiring lock "cinder-9eed0405-7908-48ea-bb4e-c598148d75f8-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-9eed0405-7908-48ea-bb4e-c598148d75f8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Acquiring lock "cinder-quobyte-9eed0405-7908-48ea-bb4e-c598148d75f8" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-quobyte-9eed0405-7908-48ea-bb4e-c598148d75f8" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:54 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[20837b45-e043-46a3-981c-f7708afc9c68]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:54 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 Nov 05 16:16:54 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:55 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8" returned: 0 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:55 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8 Nov 05 16:16:55 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:55 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9eed0405-7908-48ea-bb4e-c598148d75f8" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-quobyte-9eed0405-7908-48ea-bb4e-c598148d75f8" released by "delete_volume" :: held 0.651s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Created reservations ['f7da7f9f-39d1-4679-bb40-4dc8c6cac7aa', 'e04d5e45-36eb-4b27-90b3-1ea2fe2fcbc5', '5c1cb99b-fbfc-427f-a9e7-0b5647552b9f', '5a809d6f-3449-47f0-bbe2-672f40776cdb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:55 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:55 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Flow 'volume_create_manager' (01a079ac-c1d1-47d4-9f17-713f6655180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d61a91a-a7cb-4e40-bcef-016ff328c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d61a91a-a7cb-4e40-bcef-016ff328c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-647687257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68d6dde190144d9aa406b2a49100814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:56Z,use_quota=True,user_id='0558f1c989d24e119c5011ddf68dc8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a897b2cf-6527-4f96-8254-b0a0eeb3f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a897b2cf-6527-4f96-8254-b0a0eeb3f821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3b8b41-ec5e-4e24-beef-c103597e447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3b8b41-ec5e-4e24-beef-c103597e447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0', 'volume_name': 'volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dba31d-5fe5-416f-be9c-12c9479d3c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dba31d-5fe5-416f-be9c-12c9479d3c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc7b050-74a7-46a6-bd2b-003c78965ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:55 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Volume e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0', 'volume_size': 1} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-647687257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68d6dde190144d9aa406b2a49100814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:56Z,use_quota=True,user_id='0558f1c989d24e119c5011ddf68dc8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Creating volume e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:55 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:55 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Deleted volume successfully. Nov 05 16:16:55 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 1073741824 Nov 05 16:16:55 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30d540ea-689a-4c9b-91e2-4d508a6858c2 tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-9eed0405-7908-48ea-bb4e-c598148d75f8-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:56 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 1073741824" returned: 0 in 0.469s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:56 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 Nov 05 16:16:56 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Flow 'volume_create_manager' (7128446e-f48d-4b4f-b505-635a6b980296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3ccf3f-7bff-4d41-b880-3701b06b8f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3ccf3f-7bff-4d41-b880-3701b06b8f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1486392551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c705b74a-48e5-49e8-b6df-18304e864b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baae7bf6f5ef46c4811f9e240dab7448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:56Z,use_quota=True,user_id='0916a9050ba14e5e918e878890d0847b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31921677-9557-4c8d-b541-7295f93bc176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31921677-9557-4c8d-b541-7295f93bc176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27219def-860e-44df-a96b-8a2f0f8f5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27219def-860e-44df-a96b-8a2f0f8f5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c705b74a-48e5-49e8-b6df-18304e864b97', 'volume_name': 'volume-c705b74a-48e5-49e8-b6df-18304e864b97', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b0fdf6-21b9-480c-bee0-dd787f6b63fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b0fdf6-21b9-480c-bee0-dd787f6b63fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e06f40-8188-4b3a-83fb-b34cce8fb3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Volume c705b74a-48e5-49e8-b6df-18304e864b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c705b74a-48e5-49e8-b6df-18304e864b97', 'volume_size': 1} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:56 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" returned: 0 in 0.259s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1486392551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c705b74a-48e5-49e8-b6df-18304e864b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baae7bf6f5ef46c4811f9e240dab7448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:56Z,use_quota=True,user_id='0916a9050ba14e5e918e878890d0847b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Creating volume c705b74a-48e5-49e8-b6df-18304e864b97 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:16:56 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc7b050-74a7-46a6-bd2b-003c78965ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:56 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 1073741824 Nov 05 16:16:56 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03101449-893d-4ba7-9c75-9ba007061642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Volume volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 (e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0): created successfully Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03101449-893d-4ba7-9c75-9ba007061642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Flow 'volume_create_manager' (01a079ac-c1d1-47d4-9f17-713f6655180d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4a83ccc3-14a8-401a-9993-a6d5e0fa10b2 tempest-VolumesCloneTest-56914909 None] Created volume successfully. Nov 05 16:16:56 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 1073741824" returned: 0 in 0.421s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:56 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 Nov 05 16:16:56 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:57 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:16:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e06f40-8188-4b3a-83fb-b34cce8fb3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c705b74a-48e5-49e8-b6df-18304e864b97', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab66a34-3143-4202-99d7-5a57c43daaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:57 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Volume volume-c705b74a-48e5-49e8-b6df-18304e864b97 (c705b74a-48e5-49e8-b6df-18304e864b97): created successfully Nov 05 16:16:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab66a34-3143-4202-99d7-5a57c43daaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Flow 'volume_create_manager' (7128446e-f48d-4b4f-b505-635a6b980296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3c0308b8-df6f-496c-84c8-e5def8eebe2a tempest-VolumesTransfersV355Test-1621829410 None] Created volume successfully. Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Flow 'volume_create_manager' (16be6d2f-128f-4517-80ed-893befd78200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f21b27a-2fb2-4a2a-b2dc-13fef3f43000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f21b27a-2fb2-4a2a-b2dc-13fef3f43000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-910306954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d39b37d-5197-48a1-9039-dbdff4825761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68d6dde190144d9aa406b2a49100814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:16:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0,status='creating',terminated_at=None,updated_at=2026-11-05T15:16:58Z,use_quota=True,user_id='0558f1c989d24e119c5011ddf68dc8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce40cc88-4a51-4fcd-afea-d01650c250ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce40cc88-4a51-4fcd-afea-d01650c250ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9ee3cc-ddb3-4c72-8092-4a7547c126e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9ee3cc-ddb3-4c72-8092-4a7547c126e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d39b37d-5197-48a1-9039-dbdff4825761', 'volume_name': 'volume-6d39b37d-5197-48a1-9039-dbdff4825761', 'volume_size': 2, 'source_volid': 'e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0', 'source_volstatus': 'available'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc829573-c7b2-443d-9b7e-da864c3c03ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc829573-c7b2-443d-9b7e-da864c3c03ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b255e7b2-28f7-4089-918b-d5c494639900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:16:58 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Volume 6d39b37d-5197-48a1-9039-dbdff4825761: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d39b37d-5197-48a1-9039-dbdff4825761', 'volume_size': 2, 'source_volid': 'e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0', 'source_volstatus': 'available'} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:58 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Cloning volume e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 to volume 6d39b37d-5197-48a1-9039-dbdff4825761 Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Creating offline snapshot 9227023d-62ad-4a69-bf77-e37383c18457 of volume e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fead33-524c-45bf-8523-a1f2e0461b69]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:58 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 Nov 05 16:16:58 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Acquiring lock "cinder-c705b74a-48e5-49e8-b6df-18304e864b97-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-c705b74a-48e5-49e8-b6df-18304e864b97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Acquiring lock "cinder-quobyte-c705b74a-48e5-49e8-b6df-18304e864b97" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-quobyte-c705b74a-48e5-49e8-b6df-18304e864b97" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b8900-7846-47ee-9122-14ffdff18b31]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:58 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" returned: 0 in 0.445s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:58 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 1G Nov 05 16:16:58 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:58 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 Nov 05 16:16:58 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=89,cinder:UPDATE=118,cinder:INSERT=28,cinder:DELETE=10 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=103,cinder:UPDATE=114,cinder:INSERT=36,cinder:DELETE=11 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:16:59 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97" returned: 0 in 0.414s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:59 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97 Nov 05 16:16:59 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:59 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 1G" returned: 0 in 0.456s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:59 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 Nov 05 16:16:59 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:59 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c705b74a-48e5-49e8-b6df-18304e864b97" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-quobyte-c705b74a-48e5-49e8-b6df-18304e864b97" released by "delete_volume" :: held 0.706s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Created reservations ['baa4d8c5-f8d2-4675-841e-b987788305d5', 'a60321f5-cdee-4f06-8c70-7e9ace1ed4e9', '5cd9e500-7491-4f32-9ad6-8b918e22ff8f', '0d3d9f77-aba0-417e-8318-3850b0238668'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:16:59 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457" returned: 0 in 0.306s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:59 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 is being set with open permissions: ugo+rw Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:16:59 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 Nov 05 16:16:59 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:59 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:16:59 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:59 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457" returned: 0 in 0.257s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:16:59 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.259s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:16:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Deleted volume successfully. Nov 05 16:16:59 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.info Nov 05 16:16:59 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:16:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-10dd171a-3cc3-4fe9-ad42-c62f66b409ff tempest-VolumesTransfersV355Test-2656147 None] Lock "cinder-c705b74a-48e5-49e8-b6df-18304e864b97-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:00 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.info" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:00 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.info is being set with open permissions: ugo+rw Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:00 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.info Nov 05 16:17:00 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:00 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.info" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Acquiring lock "cinder-quobyte-6d39b37d-5197-48a1-9039-dbdff4825761" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-6d39b37d-5197-48a1-9039-dbdff4825761" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] snapshot: 9227023d-62ad-4a69-bf77-e37383c18457, volume: 6d39b37d-5197-48a1-9039-dbdff4825761, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d0c33e-6151-4692-aa1a-3841c3260f82]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:00 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 Nov 05 16:17:00 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:00 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457" returned: 0 in 0.366s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eabdebb-e91d-490e-9c83-f78e004f2e72]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:01 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 Nov 05 16:17:01 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:01 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" returned: 0 in 0.394s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:17:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:17:01 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:17:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:01 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 Nov 05 16:17:01 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:09 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761" returned: 0 in 8.263s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0, size 1024.00 MB, duration 8.27 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:17:09 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Converted 1024.00 MB image at 123.87 MB/s Nov 05 16:17:09 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 is being set with open permissions: ugo+rw Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:09 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 Nov 05 16:17:09 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-d079a64d-fca8-4fcb-b395-1faf536823d5 req-209c2965-3151-48d8-b9fe-433fbcd2aa3b tempest-TestShelveInstance-1737909259 None] Terminate volume connection completed successfully. Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-d079a64d-fca8-4fcb-b395-1faf536823d5 req-209c2965-3151-48d8-b9fe-433fbcd2aa3b tempest-TestShelveInstance-1737909259 None] Deleting attachment 67c0b37c-9ec0-4e13-9507-214f6a82eba4. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:17:09 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-6d39b37d-5197-48a1-9039-dbdff4825761" released by "_copy_volume_from_snapshot" :: held 9.375s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Acquiring lock "cinder-quobyte-9227023d-62ad-4a69-bf77-e37383c18457" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-9227023d-62ad-4a69-bf77-e37383c18457" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Deleting offline snapshot 9227023d-62ad-4a69-bf77-e37383c18457 of volume e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] snapshot_file for this snap is: volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d71e9-1e52-46c2-a83a-7a0392b408bc]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:10 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 Nov 05 16:17:10 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:10 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457" returned: 0 in 0.405s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:17:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0674bbc7-36b3-41a7-85c7-9e46c96c41ae]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:10 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 Nov 05 16:17:10 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:10 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" returned: 0 in 0.565s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:10 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 Nov 05 16:17:10 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:11 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457" returned: 0 in 0.440s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:11 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457 Nov 05 16:17:11 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Flow 'volume_create_manager' (fe191064-80af-4eea-bd71-cf5912e1ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7d9524-0bb4-4b41-b56c-626556477a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7d9524-0bb4-4b41-b56c-626556477a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-397271823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca159698-9c36-4a7c-a65e-952c2271165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223f0fdfbff459084002d9cd548a3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:11Z,use_quota=True,user_id='864107dfc4d2475aad304fb2d1c10036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6886263-c296-4d09-a414-f35cd1891416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6886263-c296-4d09-a414-f35cd1891416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c25eb3-7729-47f3-97da-b7f954f19781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c25eb3-7729-47f3-97da-b7f954f19781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca159698-9c36-4a7c-a65e-952c2271165c', 'volume_name': 'volume-ca159698-9c36-4a7c-a65e-952c2271165c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f63ed3-a4c6-4157-af21-9591bcd59292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f63ed3-a4c6-4157-af21-9591bcd59292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e806d1a5-23d1-4b02-be31-f0eee78efcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:11 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Volume ca159698-9c36-4a7c-a65e-952c2271165c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca159698-9c36-4a7c-a65e-952c2271165c', 'volume_size': 1} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:11 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0.9227023d-62ad-4a69-bf77-e37383c18457" returned: 0 in 0.318s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-9227023d-62ad-4a69-bf77-e37383c18457" released by "_delete_snapshot" :: held 1.853s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.439s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-397271823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca159698-9c36-4a7c-a65e-952c2271165c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223f0fdfbff459084002d9cd548a3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:11Z,use_quota=True,user_id='864107dfc4d2475aad304fb2d1c10036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Creating volume ca159698-9c36-4a7c-a65e-952c2271165c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:17:11 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:11 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c 1073741824 Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b255e7b2-28f7-4089-918b-d5c494639900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d39b37d-5197-48a1-9039-dbdff4825761', 'volume_size': 2, 'source_volid': 'e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0', 'source_volstatus': 'available'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:11 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa2f763-aeff-4c00-a7c5-9cbb8eea61cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:11 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Volume volume-6d39b37d-5197-48a1-9039-dbdff4825761 (6d39b37d-5197-48a1-9039-dbdff4825761): created successfully Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa2f763-aeff-4c00-a7c5-9cbb8eea61cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Flow 'volume_create_manager' (16be6d2f-128f-4517-80ed-893befd78200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-880e1208-9d0c-410f-aa0a-5a48f74145af tempest-VolumesCloneTest-56914909 None] Created volume successfully. Nov 05 16:17:12 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c 1073741824" returned: 0 in 0.468s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:12 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c Nov 05 16:17:12 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-dd9f0141-09a2-45ea-9a42-baf0ee04beaf req-972ae2d2-3b5a-4bba-8396-1fbbd6d2708b tempest-TestShelveInstance-1737909259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:12 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-dd9f0141-09a2-45ea-9a42-baf0ee04beaf req-972ae2d2-3b5a-4bba-8396-1fbbd6d2708b tempest-TestShelveInstance-1737909259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.053s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-dd9f0141-09a2-45ea-9a42-baf0ee04beaf req-972ae2d2-3b5a-4bba-8396-1fbbd6d2708b tempest-TestShelveInstance-1737909259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e806d1a5-23d1-4b02-be31-f0eee78efcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca159698-9c36-4a7c-a65e-952c2271165c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6973b0-48e9-4dfb-af9f-270ebf9d5525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:12 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Volume volume-ca159698-9c36-4a7c-a65e-952c2271165c (ca159698-9c36-4a7c-a65e-952c2271165c): created successfully Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6973b0-48e9-4dfb-af9f-270ebf9d5525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Flow 'volume_create_manager' (fe191064-80af-4eea-bd71-cf5912e1ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3d5e3974-a545-44a1-a338-fe56c8d32a2e tempest-VolumesTransfersV357Test-775352274 None] Created volume successfully. Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-dd9f0141-09a2-45ea-9a42-baf0ee04beaf req-972ae2d2-3b5a-4bba-8396-1fbbd6d2708b tempest-TestShelveInstance-1737909259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7590d99c-f3ee-46bd-a108-0847db59e55b', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:17:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-dd9f0141-09a2-45ea-9a42-baf0ee04beaf req-972ae2d2-3b5a-4bba-8396-1fbbd6d2708b tempest-TestShelveInstance-1737909259 None] attachment_update completed successfully. Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Acquiring lock "cinder-6d39b37d-5197-48a1-9039-dbdff4825761-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Lock "cinder-6d39b37d-5197-48a1-9039-dbdff4825761-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Acquiring lock "cinder-quobyte-6d39b37d-5197-48a1-9039-dbdff4825761" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-6d39b37d-5197-48a1-9039-dbdff4825761" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc8604-7e19-4c0b-86c7-2bf7677dd356]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:13 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 Nov 05 16:17:13 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:13 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:13 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761 Nov 05 16:17:13 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:13 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6d39b37d-5197-48a1-9039-dbdff4825761" returned: 0 in 0.268s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-6d39b37d-5197-48a1-9039-dbdff4825761" released by "delete_volume" :: held 0.729s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Created reservations ['9cd19701-50b3-4106-85cc-257b9344ccc6', '01fa8c5b-02a2-4af0-9183-54b3f2c1f553', 'cec693d2-16d7-45b8-b561-6f4088d550b4', '779e650d-df7a-4efd-8df2-d8af6b2a9fae'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:13 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:13 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:14 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.309s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Deleted volume successfully. Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Acquiring lock "cinder-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-61bd012c-8f6c-41f0-a2c5-3281fdd2d14c tempest-VolumesCloneTest-56914909 None] Lock "cinder-6d39b37d-5197-48a1-9039-dbdff4825761-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Lock "cinder-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Acquiring lock "cinder-quobyte-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[281320c8-0378-4eb0-8982-23a77385c079]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:14 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 Nov 05 16:17:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8605c445-3b46-44ac-9f4b-f1a1f7e77f37 tempest-VolumesTransfersV357Test-1353120395 None] Transfer volume completed successfully. Nov 05 16:17:14 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:14 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" returned: 0 in 0.443s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:14 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0 Nov 05 16:17:14 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:15 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" returned: 0 in 0.285s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Lock "cinder-quobyte-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0" released by "delete_volume" :: held 0.808s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Acquiring lock "cinder-ca159698-9c36-4a7c-a65e-952c2271165c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-ca159698-9c36-4a7c-a65e-952c2271165c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Created reservations ['a0d03055-fdb2-4ce6-a0a9-bf53fe0a39e3', 'e25730af-cc32-4c9f-956d-d752d0fedb35', 'eb5361dc-56c5-4dd8-bbd3-2c0134e2f649', '0209cb15-6d3e-44e6-a8fa-d7eee3c23f29'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Acquiring lock "cinder-quobyte-ca159698-9c36-4a7c-a65e-952c2271165c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-quobyte-ca159698-9c36-4a7c-a65e-952c2271165c" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f36f62-b884-4fc3-abbb-72ae4d975268]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:15 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:15 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:15 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c Nov 05 16:17:15 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:15 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.452s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Deleted volume successfully. Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4cfd8792-389b-4b8d-88e3-4659732eae43 tempest-VolumesCloneTest-56914909 None] Lock "cinder-e1a8b1e9-c1f8-4ebd-bde3-3d366dd49ca0-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:15 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c" returned: 0 in 0.630s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:15 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c Nov 05 16:17:15 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:16 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ca159698-9c36-4a7c-a65e-952c2271165c" returned: 0 in 0.444s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-quobyte-ca159698-9c36-4a7c-a65e-952c2271165c" released by "delete_volume" :: held 1.164s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Created reservations ['e90d37fb-cf96-441a-9a92-ce81934ac2df', '7f95376f-57b2-45a8-85ab-92b3729f8e5d', '53324ac7-4ecd-4712-9b41-1bd5fff8de37', '901ea3d1-2c87-4ff6-b15d-5076a08e9865'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:16 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:16 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:17 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.470s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:17 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Deleted volume successfully. Nov 05 16:17:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c1c8d322-c640-4d5f-af59-d68006dfcf8d tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-ca159698-9c36-4a7c-a65e-952c2271165c-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Flow 'volume_create_manager' (f59bb224-56b6-4582-997e-84fa70dbdb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e0435-c922-40b7-9bbe-e66e9daea4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e0435-c922-40b7-9bbe-e66e9daea4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-12672823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6787674d-9cf3-4887-b462-cfe2f1764d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223f0fdfbff459084002d9cd548a3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:18Z,use_quota=True,user_id='864107dfc4d2475aad304fb2d1c10036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b9fd28-3405-46a6-81fb-b2e06b4c0af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b9fd28-3405-46a6-81fb-b2e06b4c0af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25059ae7-293e-40fa-b6f7-73b0bb3af796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25059ae7-293e-40fa-b6f7-73b0bb3af796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6787674d-9cf3-4887-b462-cfe2f1764d53', 'volume_name': 'volume-6787674d-9cf3-4887-b462-cfe2f1764d53', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d0f754-d26e-4cac-a10d-d0afd77226f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d0f754-d26e-4cac-a10d-d0afd77226f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85d0304-7155-47b4-9d86-e3585e61214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Volume 6787674d-9cf3-4887-b462-cfe2f1764d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6787674d-9cf3-4887-b462-cfe2f1764d53', 'volume_size': 1} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-12672823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6787674d-9cf3-4887-b462-cfe2f1764d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5223f0fdfbff459084002d9cd548a3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:18Z,use_quota=True,user_id='864107dfc4d2475aad304fb2d1c10036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Creating volume 6787674d-9cf3-4887-b462-cfe2f1764d53 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:17:18 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:17:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:18 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 1073741824 Nov 05 16:17:18 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:19 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 1073741824" returned: 0 in 0.597s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:19 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 Nov 05 16:17:19 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:19 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85d0304-7155-47b4-9d86-e3585e61214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6787674d-9cf3-4887-b462-cfe2f1764d53', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dcb648-ac01-4fbc-9ac0-2ce0cccb496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Volume volume-6787674d-9cf3-4887-b462-cfe2f1764d53 (6787674d-9cf3-4887-b462-cfe2f1764d53): created successfully Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dcb648-ac01-4fbc-9ac0-2ce0cccb496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Flow 'volume_create_manager' (f59bb224-56b6-4582-997e-84fa70dbdb0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-cc1d4a23-72ff-45a8-a881-6403f503d13b tempest-VolumesTransfersV357Test-775352274 None] Created volume successfully. Nov 05 16:17:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Acquiring lock "cinder-6787674d-9cf3-4887-b462-cfe2f1764d53-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-6787674d-9cf3-4887-b462-cfe2f1764d53-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Acquiring lock "cinder-quobyte-6787674d-9cf3-4887-b462-cfe2f1764d53" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-quobyte-6787674d-9cf3-4887-b462-cfe2f1764d53" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1081030e-de52-42a2-8402-90c1bda04933]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:20 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 Nov 05 16:17:20 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (305de8cf-ef59-46a4-a643-ee36c09ce0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fdebf7-b6db-48fc-bfd3-0e198c6a2662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fdebf7-b6db-48fc-bfd3-0e198c6a2662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1378229167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636c37a7-9bf4-4141-98e9-3a7f29a65ad8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:21Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb10e3f-1ed3-48f2-b6e3-e7df74ea7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb10e3f-1ed3-48f2-b6e3-e7df74ea7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343f9e96-3c34-4ed5-9432-f5b0486d9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343f9e96-3c34-4ed5-9432-f5b0486d9580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636c37a7-9bf4-4141-98e9-3a7f29a65ad8', 'volume_name': 'volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf62922b-fc28-4bea-bc84-1ae567aefc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf62922b-fc28-4bea-bc84-1ae567aefc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1203d795-f0f3-4931-8e3a-ee2a27fa6a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:21 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Volume 636c37a7-9bf4-4141-98e9-3a7f29a65ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8', 'volume_size': 1} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1378229167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636c37a7-9bf4-4141-98e9-3a7f29a65ad8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:21Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Creating volume 636c37a7-9bf4-4141-98e9-3a7f29a65ad8 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:17:21 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:21 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53" returned: 0 in 0.487s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:21 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 1073741824 Nov 05 16:17:21 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:21 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53 Nov 05 16:17:21 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:21 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6787674d-9cf3-4887-b462-cfe2f1764d53" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-quobyte-6787674d-9cf3-4887-b462-cfe2f1764d53" released by "delete_volume" :: held 0.854s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Created reservations ['04021242-763e-4df2-a711-d690108e0663', '7f758b76-892f-4e4a-8bc6-c2202de63236', '65020d23-5b13-495b-8d35-0ea9c8e62aba', 'a33ae534-7ddf-4755-b1f0-8e737573490a'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:21 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:21 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:21 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 1073741824" returned: 0 in 0.527s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:21 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 Nov 05 16:17:21 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:22 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.365s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:22 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Deleted volume successfully. Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d5b5cbb-9b96-4e61-872f-f8575930d506 tempest-VolumesTransfersV357Test-1831696281 None] Lock "cinder-6787674d-9cf3-4887-b462-cfe2f1764d53-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:22 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1203d795-f0f3-4931-8e3a-ee2a27fa6a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f139f2-a724-4fb4-86ee-615b40aed416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:22 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Volume volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 (636c37a7-9bf4-4141-98e9-3a7f29a65ad8): created successfully Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f139f2-a724-4fb4-86ee-615b40aed416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (305de8cf-ef59-46a4-a643-ee36c09ce0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:22 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f5711a01-a284-4a15-9ff5-d744aaed6494 tempest-VolumesGetTest-1594265001 None] Created volume successfully. Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (a0a6cfc3-3d6b-43b5-8f4c-bcaeee80b273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9a2ab3-79ec-49d1-b36d-c0c5cb9c00fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9a2ab3-79ec-49d1-b36d-c0c5cb9c00fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-270195645',display_name='tempest-VolumesGetTest-Volume-1729142214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c0f1be-964a-4ab5-9f7e-c261c15efe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:24Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833d16aa-4134-49f7-8c37-67773b73f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833d16aa-4134-49f7-8c37-67773b73f659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd21ab66-c165-4258-963b-860fc56cc5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd21ab66-c165-4258-963b-860fc56cc5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c0f1be-964a-4ab5-9f7e-c261c15efe34', 'volume_name': 'volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b468ac-8136-48c9-80ff-881da51d0514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b468ac-8136-48c9-80ff-881da51d0514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c99a01-f9d1-44fd-a418-db83bcf088a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:24 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Volume 04c0f1be-964a-4ab5-9f7e-c261c15efe34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34', 'volume_size': 1} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-270195645',display_name='tempest-VolumesGetTest-Volume-1729142214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c0f1be-964a-4ab5-9f7e-c261c15efe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:24Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Creating volume 04c0f1be-964a-4ab5-9f7e-c261c15efe34 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:17:24 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:24 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 1073741824 Nov 05 16:17:24 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:24 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 1073741824" returned: 0 in 0.495s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:24 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 Nov 05 16:17:24 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:25 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34" returned: 0 in 0.319s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:17:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c99a01-f9d1-44fd-a418-db83bcf088a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afce1e7-b701-46d5-b099-239dc0e88721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:25 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Volume volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 (04c0f1be-964a-4ab5-9f7e-c261c15efe34): created successfully Nov 05 16:17:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afce1e7-b701-46d5-b099-239dc0e88721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (a0a6cfc3-3d6b-43b5-8f4c-bcaeee80b273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a105fa71-a11e-4fb9-94cd-c7f06c372c1a tempest-VolumesGetTest-1594265001 None] Created volume successfully. Nov 05 16:17:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-04c0f1be-964a-4ab5-9f7e-c261c15efe34-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Lock "cinder-04c0f1be-964a-4ab5-9f7e-c261c15efe34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-04c0f1be-964a-4ab5-9f7e-c261c15efe34" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-04c0f1be-964a-4ab5-9f7e-c261c15efe34" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39a25c-0ef6-4c68-ae07-fdafd7b8c6b4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:26 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 Nov 05 16:17:26 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:27 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:27 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34 Nov 05 16:17:27 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:27 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04c0f1be-964a-4ab5-9f7e-c261c15efe34" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-04c0f1be-964a-4ab5-9f7e-c261c15efe34" released by "delete_volume" :: held 0.703s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Created reservations ['6d8a4f68-d047-4941-a62d-786d5530d598', 'f6975fa9-a863-48f6-8cfd-81a8c4482287', '45c15577-d84c-4799-9449-403fbf305a4b', '06374d15-eacd-4164-8725-ac898d2eab03'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:27 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:27 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-636c37a7-9bf4-4141-98e9-3a7f29a65ad8-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:27 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.390s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Deleted volume successfully. Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Lock "cinder-636c37a7-9bf4-4141-98e9-3a7f29a65ad8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-72827f01-b914-4a75-8609-eb39c35cf156 tempest-VolumesGetTest-1594265001 None] Lock "cinder-04c0f1be-964a-4ab5-9f7e-c261c15efe34-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-636c37a7-9bf4-4141-98e9-3a7f29a65ad8" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-636c37a7-9bf4-4141-98e9-3a7f29a65ad8" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[140f07da-7010-4043-bfef-5088df1db57f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:28 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 Nov 05 16:17:28 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:28 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8" returned: 0 in 0.413s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:28 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8 Nov 05 16:17:28 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:28 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-636c37a7-9bf4-4141-98e9-3a7f29a65ad8" returned: 0 in 0.351s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-636c37a7-9bf4-4141-98e9-3a7f29a65ad8" released by "delete_volume" :: held 0.820s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:28 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Created reservations ['ada07057-53b3-49e6-a1a5-d81e454d85ed', 'bf9df6a6-bfd4-4900-ae97-5bdd23c08d9a', 'c343e3ca-4dbf-4f55-921c-93cd783807f9', 'adb95df3-3bc4-41bc-b67c-2e5518f9209d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:29 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:29 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:29 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.340s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Deleted volume successfully. Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0cd5c281-fcf0-4615-b2ff-adf1c34788c0 tempest-VolumesGetTest-1594265001 None] Lock "cinder-636c37a7-9bf4-4141-98e9-3a7f29a65ad8-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (9828617d-6be6-4d36-a3d3-e8e9a1271492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d94141-e31c-4966-809e-1c4a4dec44e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d94141-e31c-4966-809e-1c4a4dec44e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1450709169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992eddec-c4ad-4027-a9ef-0a04c934adbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:30Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8533bb1-4232-4d47-b7c7-5a362a8a5a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8533bb1-4232-4d47-b7c7-5a362a8a5a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6097e0-c16a-4b1e-a384-a1ccb9dddf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6097e0-c16a-4b1e-a384-a1ccb9dddf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992eddec-c4ad-4027-a9ef-0a04c934adbd', 'volume_name': 'volume-992eddec-c4ad-4027-a9ef-0a04c934adbd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ac1d10-7827-41d2-b1ad-40a431341dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ac1d10-7827-41d2-b1ad-40a431341dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0addd64-1404-46a7-b93a-630c729587ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:29 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Volume 992eddec-c4ad-4027-a9ef-0a04c934adbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992eddec-c4ad-4027-a9ef-0a04c934adbd', 'volume_size': 1} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1450709169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992eddec-c4ad-4027-a9ef-0a04c934adbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:30Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Creating volume 992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:17:29 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:17:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:29 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd 1073741824 Nov 05 16:17:29 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:30 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd 1073741824" returned: 0 in 0.449s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:30 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd Nov 05 16:17:30 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:30 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0addd64-1404-46a7-b93a-630c729587ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992eddec-c4ad-4027-a9ef-0a04c934adbd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe2bf1-0237-4474-97d2-ece18a169855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Volume volume-992eddec-c4ad-4027-a9ef-0a04c934adbd (992eddec-c4ad-4027-a9ef-0a04c934adbd): created successfully Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe2bf1-0237-4474-97d2-ece18a169855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (9828617d-6be6-4d36-a3d3-e8e9a1271492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c7c35bd6-4e65-4f5b-b1ce-ba6078bb0ee2 tempest-VolumesGetTest-1594265001 None] Created volume successfully. Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (581ad449-4bd3-4d20-8821-0acc927135f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35564604-8dc6-4296-a2aa-f80d565f6c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35564604-8dc6-4296-a2aa-f80d565f6c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1801655322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061261d5-3dd8-4b0a-8876-35f0714f1084,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=992eddec-c4ad-4027-a9ef-0a04c934adbd,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:31Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40749b52-6da6-48cd-8177-c5ea18b6b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40749b52-6da6-48cd-8177-c5ea18b6b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb981be-8691-4557-b987-a0f925a89c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb981be-8691-4557-b987-a0f925a89c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '061261d5-3dd8-4b0a-8876-35f0714f1084', 'volume_name': 'volume-061261d5-3dd8-4b0a-8876-35f0714f1084', 'volume_size': 1, 'source_volid': '992eddec-c4ad-4027-a9ef-0a04c934adbd', 'source_volstatus': 'available'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5ca7c7-de1c-4b24-a716-b4da23a0e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5ca7c7-de1c-4b24-a716-b4da23a0e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76be8c78-3941-44e5-a319-b636002a4ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Volume 061261d5-3dd8-4b0a-8876-35f0714f1084: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-061261d5-3dd8-4b0a-8876-35f0714f1084', 'volume_size': 1, 'source_volid': '992eddec-c4ad-4027-a9ef-0a04c934adbd', 'source_volstatus': 'available'} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:31 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Cloning volume 992eddec-c4ad-4027-a9ef-0a04c934adbd to volume 061261d5-3dd8-4b0a-8876-35f0714f1084 Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Creating offline snapshot c28f7beb-9c5b-4da0-999e-e1deeeaa9219 of volume 992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d873ca17-6f7b-432c-bcdb-4a4632d9e0b4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:31 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd Nov 05 16:17:31 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:31 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:31 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 1G Nov 05 16:17:31 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:32 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 1G" returned: 0 in 0.439s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992eddec-c4ad-4027-a9ef-0a04c934adbd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:32 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992eddec-c4ad-4027-a9ef-0a04c934adbd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 Nov 05 16:17:32 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:32 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-992eddec-c4ad-4027-a9ef-0a04c934adbd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219" returned: 0 in 0.474s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:32 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 is being set with open permissions: ugo+rw Nov 05 16:17:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:32 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 Nov 05 16:17:32 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:33 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219" returned: 0 in 0.293s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:33 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.info Nov 05 16:17:33 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:33 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.info" returned: 0 in 0.351s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:33 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.info is being set with open permissions: ugo+rw Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:33 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.info Nov 05 16:17:33 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:33 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.info" returned: 0 in 0.358s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-061261d5-3dd8-4b0a-8876-35f0714f1084" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-061261d5-3dd8-4b0a-8876-35f0714f1084" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] snapshot: c28f7beb-9c5b-4da0-999e-e1deeeaa9219, volume: 061261d5-3dd8-4b0a-8876-35f0714f1084, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dbf52c-f202-4038-86ce-a9857a8a8d8c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:34 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 Nov 05 16:17:34 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:34 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219" returned: 0 in 0.447s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-992eddec-c4ad-4027-a9ef-0a04c934adbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0778bee-d3a9-487a-8c63-ccbe3f512c50]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:34 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd Nov 05 16:17:34 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:34 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd" returned: 0 in 0.415s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:17:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:34 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 Nov 05 16:17:34 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=59,cinder:INSERT=18,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:17:43 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=72,cinder:DELETE=8 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084" returned: 0 in 8.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd, size 1024.00 MB, duration 8.27 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:17:43 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Converted 1024.00 MB image at 123.85 MB/s Nov 05 16:17:43 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 is being set with open permissions: ugo+rw Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:43 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 Nov 05 16:17:43 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:43 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-061261d5-3dd8-4b0a-8876-35f0714f1084" released by "_copy_volume_from_snapshot" :: held 9.482s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-c28f7beb-9c5b-4da0-999e-e1deeeaa9219" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-c28f7beb-9c5b-4da0-999e-e1deeeaa9219" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Deleting offline snapshot c28f7beb-9c5b-4da0-999e-e1deeeaa9219 of volume 992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] snapshot_file for this snap is: volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf79dcb-62c5-4c93-a1b8-8b49d354f0ca]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:43 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 Nov 05 16:17:43 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:43 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-992eddec-c4ad-4027-a9ef-0a04c934adbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[32732a27-f8b6-4e84-802f-991681981d45]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:43 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd Nov 05 16:17:43 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:44 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd" returned: 0 in 0.526s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:44 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 Nov 05 16:17:44 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:44 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219" returned: 0 in 0.459s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:44 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219 Nov 05 16:17:44 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:45 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd.c28f7beb-9c5b-4da0-999e-e1deeeaa9219" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-c28f7beb-9c5b-4da0-999e-e1deeeaa9219" released by "_delete_snapshot" :: held 1.729s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.740s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76be8c78-3941-44e5-a319-b636002a4ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061261d5-3dd8-4b0a-8876-35f0714f1084', 'volume_size': 1, 'source_volid': '992eddec-c4ad-4027-a9ef-0a04c934adbd', 'source_volstatus': 'available'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afbbc20-366e-468d-9456-f5a35030f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:45 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Volume volume-061261d5-3dd8-4b0a-8876-35f0714f1084 (061261d5-3dd8-4b0a-8876-35f0714f1084): created successfully Nov 05 16:17:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afbbc20-366e-468d-9456-f5a35030f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (581ad449-4bd3-4d20-8821-0acc927135f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c8c0e6d5-cbba-4ef1-9646-eb3011cd7565 tempest-VolumesGetTest-1594265001 None] Created volume successfully. Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (b9cd7dce-775e-448e-8a7e-54663e8cd93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5c43fa-40b5-4570-ba5d-2b667b215fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5c43fa-40b5-4570-ba5d-2b667b215fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1663586116',display_name='tempest-VolumesGetTest-Volume-1771049769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25df8021-5c69-430e-91b7-f585f58f7db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:46Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fb2d1f-d1bb-406b-b8fc-743437545259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fb2d1f-d1bb-406b-b8fc-743437545259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11302d7c-8eb9-402d-adf4-d18ff6e478ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11302d7c-8eb9-402d-adf4-d18ff6e478ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25df8021-5c69-430e-91b7-f585f58f7db8', 'volume_name': 'volume-25df8021-5c69-430e-91b7-f585f58f7db8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16eda13-cab0-4b3d-b566-d5085c5a25c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16eda13-cab0-4b3d-b566-d5085c5a25c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3079ea-fd63-408e-a805-028ffcdf1a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:46 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Volume 25df8021-5c69-430e-91b7-f585f58f7db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25df8021-5c69-430e-91b7-f585f58f7db8', 'volume_size': 1} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1663586116',display_name='tempest-VolumesGetTest-Volume-1771049769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25df8021-5c69-430e-91b7-f585f58f7db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:46Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Creating volume 25df8021-5c69-430e-91b7-f585f58f7db8 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:17:46 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:46 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 1073741824 Nov 05 16:17:46 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:46 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 1073741824" returned: 0 in 0.493s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:47 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 Nov 05 16:17:47 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:47 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:17:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3079ea-fd63-408e-a805-028ffcdf1a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25df8021-5c69-430e-91b7-f585f58f7db8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e9212d-d0e4-4a54-97ca-0e3d65b63dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:47 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Volume volume-25df8021-5c69-430e-91b7-f585f58f7db8 (25df8021-5c69-430e-91b7-f585f58f7db8): created successfully Nov 05 16:17:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e9212d-d0e4-4a54-97ca-0e3d65b63dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (b9cd7dce-775e-448e-8a7e-54663e8cd93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-69a1cd90-6d7c-4461-915d-40b3fe0e22f2 tempest-VolumesGetTest-1594265001 None] Created volume successfully. Nov 05 16:17:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-25df8021-5c69-430e-91b7-f585f58f7db8-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Lock "cinder-25df8021-5c69-430e-91b7-f585f58f7db8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-25df8021-5c69-430e-91b7-f585f58f7db8" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-25df8021-5c69-430e-91b7-f585f58f7db8" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[af912180-c403-4b63-995c-c0744cf0f372]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:48 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 Nov 05 16:17:48 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:49 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8" returned: 0 in 0.393s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:49 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8 Nov 05 16:17:49 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:49 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-25df8021-5c69-430e-91b7-f585f58f7db8" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-25df8021-5c69-430e-91b7-f585f58f7db8" released by "delete_volume" :: held 0.697s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Created reservations ['ba77b99e-d003-4273-94ad-ec6031c46ca0', 'b6dc8ec7-1644-4c1b-9c89-bd0941c44016', '683d14c7-fb77-4615-90dd-5e2aafed643a', 'c17b5a49-43bb-4eee-b91a-c45f2533e359'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:49 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:49 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-061261d5-3dd8-4b0a-8876-35f0714f1084-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Lock "cinder-061261d5-3dd8-4b0a-8876-35f0714f1084-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-061261d5-3dd8-4b0a-8876-35f0714f1084" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-061261d5-3dd8-4b0a-8876-35f0714f1084" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:49 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.468s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:49 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:49 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Deleted volume successfully. Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0710e6-964b-46e4-b91a-46a1c72dd9cc]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0bb7f57f-43fd-4248-a7d6-13fe14beb758 tempest-VolumesGetTest-1594265001 None] Lock "cinder-25df8021-5c69-430e-91b7-f585f58f7db8-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:50 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 Nov 05 16:17:50 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:50 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:50 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:50 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084" returned: 0 in 0.463s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:50 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:17:50 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084 Nov 05 16:17:50 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:50 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061261d5-3dd8-4b0a-8876-35f0714f1084" returned: 0 in 0.269s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-061261d5-3dd8-4b0a-8876-35f0714f1084" released by "delete_volume" :: held 0.798s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Created reservations ['8bef20d0-754b-49fa-81fa-454c28b207c1', 'ae47706e-6ea3-41a1-ae2c-f44705f2f02b', '07659c0f-03ab-4361-adb4-15560b9e4ea2', 'fca15788-6769-4409-bebe-b233c9a2d83a'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:50 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:50 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:51 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.266s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-992eddec-c4ad-4027-a9ef-0a04c934adbd-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Deleted volume successfully. Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Lock "cinder-992eddec-c4ad-4027-a9ef-0a04c934adbd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-eb1f4417-530e-449d-9d2f-769263228a63 tempest-VolumesGetTest-1594265001 None] Lock "cinder-061261d5-3dd8-4b0a-8876-35f0714f1084-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-992eddec-c4ad-4027-a9ef-0a04c934adbd" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-992eddec-c4ad-4027-a9ef-0a04c934adbd" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cce8a7-dfe6-4a23-8a72-a186dd6bc37d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:51 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd Nov 05 16:17:51 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:51 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd" returned: 0 in 0.385s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:51 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd Nov 05 16:17:51 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:51 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-992eddec-c4ad-4027-a9ef-0a04c934adbd" returned: 0 in 0.260s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-992eddec-c4ad-4027-a9ef-0a04c934adbd" released by "delete_volume" :: held 0.715s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Created reservations ['7a78c5a4-ad9a-407b-b4b5-77d1683407d6', '2bff5442-ec8a-4b70-8369-4f2cb76a461f', '2a1da4b0-f5a1-4cd9-949e-aa89e11d8f50', '8789c5c8-36cf-4bfd-b01f-9bbf800806da'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:52 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:17:52 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:52 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:17:52 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Deleted volume successfully. Nov 05 16:17:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b175a058-dc75-47ea-b3b1-0fc2d5bc12c9 tempest-VolumesGetTest-1594265001 None] Lock "cinder-992eddec-c4ad-4027-a9ef-0a04c934adbd-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (2ddf2b5e-33a9-4cd2-9bad-48f2c2769a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27a5557-4e2a-4a33-a828-b754dc68ad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27a5557-4e2a-4a33-a828-b754dc68ad50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1016276801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341a79c9-d697-4399-b73b-f8a14b213fb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:53Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa0133f-3b58-422a-8ef4-60a204b8be12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa0133f-3b58-422a-8ef4-60a204b8be12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fea75bc-00d1-48fd-a1cf-41c544bc2c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fea75bc-00d1-48fd-a1cf-41c544bc2c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '341a79c9-d697-4399-b73b-f8a14b213fb4', 'volume_name': 'volume-341a79c9-d697-4399-b73b-f8a14b213fb4', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbff0ad9-dd4d-4fbb-b772-82cf626705c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbff0ad9-dd4d-4fbb-b772-82cf626705c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39063313-716a-4b4d-9374-49f941f13ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:17:53 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Volume 341a79c9-d697-4399-b73b-f8a14b213fb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-341a79c9-d697-4399-b73b-f8a14b213fb4', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Trying to clone 341a79c9-d697-4399-b73b-f8a14b213fb4 from image db5f453d-0d67-42b5-9b27-8a3136fce700 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:17:53 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Image download 20.69 MB at 20.69 MB/s Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edbee41-dc42-44f6-8106-5466ea76dfe3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:54 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD Nov 05 16:17:54 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:54 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 is fetched for user ff4fc424cc764f738fbf310b8989380b. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d52ee4-d0f4-4912-ac83-e5df39546d14]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:54 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD Nov 05 16:17:54 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:54 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1016276801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341a79c9-d697-4399-b73b-f8a14b213fb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:17:53Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Creating volume 341a79c9-d697-4399-b73b-f8a14b213fb4 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:17:54 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:17:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:54 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 1073741824 Nov 05 16:17:54 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:55 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 1073741824" returned: 0 in 0.531s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:55 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 Nov 05 16:17:55 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:55 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4" returned: 0 in 0.297s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Attempting download of db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume 341a79c9-d697-4399-b73b-f8a14b213fb4. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[47391326-5ef6-44fa-9699-2cb47402d998]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700___xwzr3s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:55 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700___xwzr3s Nov 05 16:17:55 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:56 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700___xwzr3s" returned: 0 in 0.437s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700___xwzr3s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:56 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700___xwzr3s Nov 05 16:17:56 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:56 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700___xwzr3s" returned: 1 in 0.515s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db5f453d-0d67-42b5-9b27-8a3136fce700___xwzr3s' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:17:56 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6b9d13-73b4-4e58-b633-24b08e9b7b26]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:17:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:56 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD Nov 05 16:17:56 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:57 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Nov 05 16:17:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD" returned: 0 in 0.630s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:17:57 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] db5f453d-0d67-42b5-9b27-8a3136fce700 was qcow2, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:17:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:17:57 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 Nov 05 16:17:57 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:17:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-3e4cd43f-7914-43c0-b60b-226e897c3f60 tempest-TestShelveInstance-1737909259 None] Terminate volume connection completed successfully. Nov 05 16:17:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-3e4cd43f-7914-43c0-b60b-226e897c3f60 tempest-TestShelveInstance-1737909259 None] Deleting attachment 7590d99c-f3ee-46bd-a108-0847db59e55b. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:18:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Acquiring lock "cinder-c6a64141-0846-4d17-a2cb-fa27b4d07a1b-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Lock "cinder-c6a64141-0846-4d17-a2cb-fa27b4d07a1b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Acquiring lock "cinder-quobyte-c6a64141-0846-4d17-a2cb-fa27b4d07a1b" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Lock "cinder-quobyte-c6a64141-0846-4d17-a2cb-fa27b4d07a1b" acquired by "delete_volume" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72ed091-bdb4-4ca3-b48f-dcc3b525ced2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:00 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b Nov 05 16:18:00 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:01 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4" returned: 0 in 3.857s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:01 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db5f453d-0d67-42b5-9b27-8a3136fce700_pj7z3kkedevstack@QuobyteHD, size 112.00 MB, duration 3.86 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:18:01 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Converted 112.00 MB image at 29.03 MB/s Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b" returned: 0 in 0.964s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:01 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 1G Nov 05 16:18:01 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:01 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b Nov 05 16:18:01 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:01 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c6a64141-0846-4d17-a2cb-fa27b4d07a1b" returned: 0 in 0.308s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Lock "cinder-quobyte-c6a64141-0846-4d17-a2cb-fa27b4d07a1b" released by "delete_volume" :: held 1.382s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.quota [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Created reservations ['e4e1fd42-bce6-4d39-93e0-deec822b7cfe', '12cd29d8-40a9-4566-a1ba-7ae8f3a23ace', '768616b0-64c0-49de-b0fe-02a480bf7db9', 'c7750ffb-36fc-4f2f-85f1-1a46a8b264a0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:18:01 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 1G" returned: 0 in 0.435s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Downloaded image db5f453d-0d67-42b5-9b27-8a3136fce700 ((None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}])) to volume 341a79c9-d697-4399-b73b-f8a14b213fb4 successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Temporary image db5f453d-0d67-42b5-9b27-8a3136fce700 for user ff4fc424cc764f738fbf310b8989380b is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Marking volume 341a79c9-d697-4399-b73b-f8a14b213fb4 as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Copying metadata from image db5f453d-0d67-42b5-9b27-8a3136fce700 to 341a79c9-d697-4399-b73b-f8a14b213fb4. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Creating volume glance metadata for volume 341a79c9-d697-4399-b73b-f8a14b213fb4 backed by image db5f453d-0d67-42b5-9b27-8a3136fce700 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:01 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:18:01 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39063313-716a-4b4d-9374-49f941f13ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341a79c9-d697-4399-b73b-f8a14b213fb4', 'volume_size': 1, 'image_id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db5f453d-0d67-42b5-9b27-8a3136fce700', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5d672a0f966242c4a9cc846f30b3cd96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'db5f453d-0d67-42b5-9b27-8a3136fce700', 'created_at': datetime.datetime(2026, 11, 5, 15, 0, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 0, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db5f453d-0d67-42b5-9b27-8a3136fce700/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a635de8-37b8-4b2a-ba4e-c126a42defcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:01 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Volume volume-341a79c9-d697-4399-b73b-f8a14b213fb4 (341a79c9-d697-4399-b73b-f8a14b213fb4): created successfully Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a635de8-37b8-4b2a-ba4e-c126a42defcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (2ddf2b5e-33a9-4cd2-9bad-48f2c2769a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9aefc3ab-ba8b-497d-9a5a-6014c963272c tempest-VolumesGetTest-1594265001 None] Created volume successfully. Nov 05 16:18:02 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.303s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:02 devstack cinder-volume[86924]: DEBUG cinder.manager [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:18:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Deleted volume successfully. Nov 05 16:18:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [req-a384a741-54af-4b40-b3ec-7ba3cdfbdccd req-c0864d91-39d9-44af-ba0f-a3ce5f16ed24 tempest-TestShelveInstance-1737909259 None] Lock "cinder-c6a64141-0846-4d17-a2cb-fa27b4d07a1b-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (e0178841-34fa-4a3e-816a-aae27bac27bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58fb012-5df4-4966-9913-0ed4c1cd98f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58fb012-5df4-4966-9913-0ed4c1cd98f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1536544870',display_name='tempest-VolumesGetTest-Volume-402405628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50b079b-6267-44c4-a9de-00c6f53d8409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:04Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74a3eea-a305-4563-baf2-2b786a3b6a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74a3eea-a305-4563-baf2-2b786a3b6a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6026c01-feb7-4062-9a65-d93e571ff69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6026c01-feb7-4062-9a65-d93e571ff69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50b079b-6267-44c4-a9de-00c6f53d8409', 'volume_name': 'volume-b50b079b-6267-44c4-a9de-00c6f53d8409', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5456824d-cdeb-4c74-b79a-1a918d88a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5456824d-cdeb-4c74-b79a-1a918d88a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc74dfd-5f20-459b-b565-633b85c42d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:04 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Volume b50b079b-6267-44c4-a9de-00c6f53d8409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50b079b-6267-44c4-a9de-00c6f53d8409', 'volume_size': 1} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1536544870',display_name='tempest-VolumesGetTest-Volume-402405628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50b079b-6267-44c4-a9de-00c6f53d8409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='578684818e56461db55c223608b7e8fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:04Z,use_quota=True,user_id='ff4fc424cc764f738fbf310b8989380b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Creating volume b50b079b-6267-44c4-a9de-00c6f53d8409 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:18:04 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:04 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 1073741824 Nov 05 16:18:04 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:04 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 1073741824" returned: 0 in 0.511s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:04 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 Nov 05 16:18:04 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:05 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409" returned: 0 in 0.315s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:18:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc74dfd-5f20-459b-b565-633b85c42d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50b079b-6267-44c4-a9de-00c6f53d8409', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a963853f-c6a7-4187-a934-3b3529c6a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:05 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Volume volume-b50b079b-6267-44c4-a9de-00c6f53d8409 (b50b079b-6267-44c4-a9de-00c6f53d8409): created successfully Nov 05 16:18:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a963853f-c6a7-4187-a934-3b3529c6a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:05 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Flow 'volume_create_manager' (e0178841-34fa-4a3e-816a-aae27bac27bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f19777e6-7648-430e-ba1a-93984120b0aa tempest-VolumesGetTest-1594265001 None] Created volume successfully. Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-b50b079b-6267-44c4-a9de-00c6f53d8409-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Lock "cinder-b50b079b-6267-44c4-a9de-00c6f53d8409-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-b50b079b-6267-44c4-a9de-00c6f53d8409" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-b50b079b-6267-44c4-a9de-00c6f53d8409" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92b925b-e218-46f3-8e8e-cd209dbb606a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:06 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 Nov 05 16:18:06 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:06 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409" returned: 0 in 0.412s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:06 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409 Nov 05 16:18:06 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:07 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b50b079b-6267-44c4-a9de-00c6f53d8409" returned: 0 in 0.373s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-b50b079b-6267-44c4-a9de-00c6f53d8409" released by "delete_volume" :: held 0.831s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Created reservations ['9765a69c-13c4-4e9a-afc2-8c8718c93705', 'c2250305-bdc5-4b13-b0f2-957eee818078', '1b32fde2-9822-4b1c-901f-f284bbe61852', '275fe628-7293-44cc-8ae1-44922c204277'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:07 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:18:07 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-341a79c9-d697-4399-b73b-f8a14b213fb4-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Lock "cinder-341a79c9-d697-4399-b73b-f8a14b213fb4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Acquiring lock "cinder-quobyte-341a79c9-d697-4399-b73b-f8a14b213fb4" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:07 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.428s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:18:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Deleted volume successfully. Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-341a79c9-d697-4399-b73b-f8a14b213fb4" acquired by "delete_volume" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a25bd758-11a1-428f-83c2-7e4a7acbe35e tempest-VolumesGetTest-1594265001 None] Lock "cinder-b50b079b-6267-44c4-a9de-00c6f53d8409-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfec854-a75a-4051-97d1-1e84b1929ef7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:07 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 Nov 05 16:18:07 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:08 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4" returned: 0 in 0.446s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:08 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4 Nov 05 16:18:08 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:08 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-341a79c9-d697-4399-b73b-f8a14b213fb4" returned: 0 in 0.278s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Lock "cinder-quobyte-341a79c9-d697-4399-b73b-f8a14b213fb4" released by "delete_volume" :: held 0.788s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Created reservations ['f986ad1e-9d41-4218-8653-c0c673058eb1', 'befee91e-c241-4091-8403-880be8de7759', '35771eb7-319f-4246-a703-dbdf296b271c', 'faf83132-9bc0-4922-82c1-14ceda4cc03b'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:08 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:18:08 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:09 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:09 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:18:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Deleted volume successfully. Nov 05 16:18:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-82032a38-ab29-4538-99cc-49d132f30c74 tempest-VolumesGetTest-1594265001 None] Lock "cinder-341a79c9-d697-4399-b73b-f8a14b213fb4-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:18 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=63,cinder:SELECT=44,cinder:INSERT=24,cinder:DELETE=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:18:19 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=61,cinder:SELECT=47,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (1dc36619-953d-4b5a-addc-4aed09a08b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b788a1fc-3dcb-4a5e-aa51-a365bd6ae730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b788a1fc-3dcb-4a5e-aa51-a365bd6ae730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1783489477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258271f0-2e38-4975-879d-7dcd66d052ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:28Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a61b658-bcee-40fe-a25c-941ba2af81f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a61b658-bcee-40fe-a25c-941ba2af81f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3255005-8271-44e8-a34c-f65979888f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3255005-8271-44e8-a34c-f65979888f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258271f0-2e38-4975-879d-7dcd66d052ae', 'volume_name': 'volume-258271f0-2e38-4975-879d-7dcd66d052ae', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf78d19-aec8-4a8c-b2e6-ae42c847f82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf78d19-aec8-4a8c-b2e6-ae42c847f82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3702b2b5-4ea0-48cf-bef7-5315eef93659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:27 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume 258271f0-2e38-4975-879d-7dcd66d052ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258271f0-2e38-4975-879d-7dcd66d052ae', 'volume_size': 1} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1783489477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258271f0-2e38-4975-879d-7dcd66d052ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:28Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Creating volume 258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:18:27 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:18:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:27 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae 1073741824 Nov 05 16:18:27 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:28 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae 1073741824" returned: 0 in 0.480s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:28 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae Nov 05 16:18:28 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:28 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae" returned: 0 in 0.274s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3702b2b5-4ea0-48cf-bef7-5315eef93659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258271f0-2e38-4975-879d-7dcd66d052ae', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806d1c2c-3506-47ef-9f07-44b393046586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:28 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume volume-258271f0-2e38-4975-879d-7dcd66d052ae (258271f0-2e38-4975-879d-7dcd66d052ae): created successfully Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806d1c2c-3506-47ef-9f07-44b393046586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (1dc36619-953d-4b5a-addc-4aed09a08b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-deaece31-9689-4ef8-8c87-8608274d3f55 tempest-VolumesSnapshotTestJSON-1687800320 None] Created volume successfully. Nov 05 16:18:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Creating offline snapshot 1bd2befb-3ef9-4282-a25f-76abaab302d9 of volume 258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:18:30 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87439b1-a157-448e-ad4a-58bfb4f71abe]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:30 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae Nov 05 16:18:30 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:30 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae" returned: 0 in 0.481s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:30 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 1G Nov 05 16:18:30 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Flow 'volume_create_manager' (86b8f499-d9e4-4a10-a962-41df069372a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ab9124-2d1c-42fa-8c5d-f416843fcd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ab9124-2d1c-42fa-8c5d-f416843fcd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-164798205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87731d5-b5eb-4638-88e2-f29a720a0321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755132bda31f47d1895ad23f4483022b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:31Z,use_quota=True,user_id='57e9b769c6264a8883a094238267fb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624b6da0-d5c7-49cc-b534-736f488e543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624b6da0-d5c7-49cc-b534-736f488e543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6cfcb9-36f5-49e6-b9d9-45fe24cfe7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6cfcb9-36f5-49e6-b9d9-45fe24cfe7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87731d5-b5eb-4638-88e2-f29a720a0321', 'volume_name': 'volume-f87731d5-b5eb-4638-88e2-f29a720a0321', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3cf69c-2886-489f-b7fa-83a5ac9753d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3cf69c-2886-489f-b7fa-83a5ac9753d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb60f68b-3856-49c0-a4f7-eae0244ff8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Volume f87731d5-b5eb-4638-88e2-f29a720a0321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87731d5-b5eb-4638-88e2-f29a720a0321', 'volume_size': 1} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:31 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 1G" returned: 0 in 0.456s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258271f0-2e38-4975-879d-7dcd66d052ae -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:31 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258271f0-2e38-4975-879d-7dcd66d052ae -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 Nov 05 16:18:31 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:31 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258271f0-2e38-4975-879d-7dcd66d052ae -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9" returned: 0 in 0.301s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:31 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 is being set with open permissions: ugo+rw Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:31 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 Nov 05 16:18:31 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:31 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9" returned: 0 in 0.338s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:31 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.info Nov 05 16:18:31 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:32 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.info" returned: 0 in 0.273s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:32 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.info is being set with open permissions: ugo+rw Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:32 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.info Nov 05 16:18:32 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:32 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.info" returned: 0 in 0.256s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.283s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-164798205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87731d5-b5eb-4638-88e2-f29a720a0321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755132bda31f47d1895ad23f4483022b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:31Z,use_quota=True,user_id='57e9b769c6264a8883a094238267fb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Creating volume f87731d5-b5eb-4638-88e2-f29a720a0321 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:18:32 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:32 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 1073741824 Nov 05 16:18:32 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e21f2938-75dd-4a12-ba36-2bfed9d56317 tempest-VolumesSnapshotTestJSON-1687800320 None] Create snapshot completed successfully Nov 05 16:18:32 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 1073741824" returned: 0 in 0.491s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:33 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 Nov 05 16:18:33 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:33 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb60f68b-3856-49c0-a4f7-eae0244ff8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87731d5-b5eb-4638-88e2-f29a720a0321', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14563433-c69e-4a49-852f-faa700f67e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Volume volume-f87731d5-b5eb-4638-88e2-f29a720a0321 (f87731d5-b5eb-4638-88e2-f29a720a0321): created successfully Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14563433-c69e-4a49-852f-faa700f67e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Flow 'volume_create_manager' (86b8f499-d9e4-4a10-a962-41df069372a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4f00cbf5-5728-4f38-aaf3-f3226f69bb40 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Created volume successfully. Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-1bd2befb-3ef9-4282-a25f-76abaab302d9-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-1bd2befb-3ef9-4282-a25f-76abaab302d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-258271f0-2e38-4975-879d-7dcd66d052ae" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-258271f0-2e38-4975-879d-7dcd66d052ae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-1bd2befb-3ef9-4282-a25f-76abaab302d9" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-1bd2befb-3ef9-4282-a25f-76abaab302d9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Deleting offline snapshot 1bd2befb-3ef9-4282-a25f-76abaab302d9 of volume 258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] snapshot_file for this snap is: volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[956395a1-8332-4cb6-911b-719ebe90c613]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:33 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 Nov 05 16:18:33 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:34 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9" returned: 0 in 0.455s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258271f0-2e38-4975-879d-7dcd66d052ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:18:34 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[117c6c2c-aa69-43cc-aed9-2607081d35a0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:34 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae Nov 05 16:18:34 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:34 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae" returned: 0 in 0.475s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:34 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 Nov 05 16:18:34 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:35 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9" returned: 0 in 0.444s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:35 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9 Nov 05 16:18:35 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-d3bca169-449e-43aa-be67-8898a07c16cf req-77d051b4-9a69-433b-ae0b-8d6f77afa118 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-d3bca169-449e-43aa-be67-8898a07c16cf req-77d051b4-9a69-433b-ae0b-8d6f77afa118 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-d3bca169-449e-43aa-be67-8898a07c16cf req-77d051b4-9a69-433b-ae0b-8d6f77afa118 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-d3bca169-449e-43aa-be67-8898a07c16cf req-77d051b4-9a69-433b-ae0b-8d6f77afa118 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-f87731d5-b5eb-4638-88e2-f29a720a0321', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0db36a20-9941-4e06-bf08-dfdca12da765', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:18:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-d3bca169-449e-43aa-be67-8898a07c16cf req-77d051b4-9a69-433b-ae0b-8d6f77afa118 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] attachment_update completed successfully. Nov 05 16:18:35 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae.1bd2befb-3ef9-4282-a25f-76abaab302d9" returned: 0 in 0.308s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-1bd2befb-3ef9-4282-a25f-76abaab302d9" released by "_delete_snapshot" :: held 1.837s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-258271f0-2e38-4975-879d-7dcd66d052ae" released by "delete_snapshot" :: held 1.869s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['1168a9cb-940f-48b4-a870-d024916650e5', '43619095-736a-4c08-ae5c-13020223aced', 'e4a7de66-01b2-4ed6-bfe7-2a0dc0572ba0', 'b6bd26a8-82c0-4820-8258-5b448ebf7013'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:18:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Delete snapshot completed successfully. Nov 05 16:18:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-99ae2d04-c1b1-4507-acea-e3769177448a tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-1bd2befb-3ef9-4282-a25f-76abaab302d9-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (daba1b58-4dd0-49a5-a742-67b7d4f84963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca07fff-fa78-4728-8344-6234650725f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca07fff-fa78-4728-8344-6234650725f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957215210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f0fc14-1a1f-4a50-b135-5a38d7e1ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:36Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20523cfe-2a2d-44bd-93f1-8283c13440e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20523cfe-2a2d-44bd-93f1-8283c13440e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dd5c11-efc7-4643-b78b-c7ac774abc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2dd5c11-efc7-4643-b78b-c7ac774abc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f0fc14-1a1f-4a50-b135-5a38d7e1ed61', 'volume_name': 'volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0377d8f-6dbd-4957-8320-c7601a88ccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0377d8f-6dbd-4957-8320-c7601a88ccb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a39f390-98e2-42a3-9166-43c0b31f25a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:36 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume 94f0fc14-1a1f-4a50-b135-5a38d7e1ed61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61', 'volume_size': 1} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957215210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f0fc14-1a1f-4a50-b135-5a38d7e1ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:36Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Creating volume 94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:18:36 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:18:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:36 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 1073741824 Nov 05 16:18:36 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:37 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 1073741824" returned: 0 in 0.475s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:37 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 Nov 05 16:18:37 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:37 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a39f390-98e2-42a3-9166-43c0b31f25a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a8934d-0855-4a05-ab14-38ed7dbd4574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 (94f0fc14-1a1f-4a50-b135-5a38d7e1ed61): created successfully Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a8934d-0855-4a05-ab14-38ed7dbd4574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (daba1b58-4dd0-49a5-a742-67b7d4f84963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-704e5f2d-cf26-4e57-8a3b-af4f9a123b35 tempest-VolumesSnapshotTestJSON-1687800320 None] Created volume successfully. Nov 05 16:18:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Creating offline snapshot dc5d2846-fca3-4f0c-9a6a-574127322caa of volume 94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:18:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e41158f-ea1d-40c8-9282-da631113f066]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:38 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 Nov 05 16:18:38 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-0a470480-2ad7-4e2d-b421-6b688f760191 req-3bc70711-a59f-4f55-984d-f803f2b607df tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Terminate volume connection completed successfully. Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-0a470480-2ad7-4e2d-b421-6b688f760191 req-3bc70711-a59f-4f55-984d-f803f2b607df tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Deleting attachment 0db36a20-9941-4e06-bf08-dfdca12da765. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:18:39 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" returned: 0 in 0.471s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:39 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa 1G Nov 05 16:18:39 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:39 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa 1G" returned: 0 in 0.490s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:39 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa Nov 05 16:18:39 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Acquiring lock "cinder-f87731d5-b5eb-4638-88e2-f29a720a0321-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "cinder-f87731d5-b5eb-4638-88e2-f29a720a0321-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Acquiring lock "cinder-quobyte-f87731d5-b5eb-4638-88e2-f29a720a0321" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "cinder-quobyte-f87731d5-b5eb-4638-88e2-f29a720a0321" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac85de5d-421d-4444-8da2-951741e26a8b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:40 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa" returned: 0 in 0.339s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:40 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa is being set with open permissions: ugo+rw Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:40 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa Nov 05 16:18:40 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:40 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 Nov 05 16:18:40 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:40 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:40 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.info Nov 05 16:18:40 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:40 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:40 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321 Nov 05 16:18:40 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:40 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.info" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:40 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.info is being set with open permissions: ugo+rw Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:40 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.info Nov 05 16:18:40 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:40 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f87731d5-b5eb-4638-88e2-f29a720a0321" returned: 0 in 0.274s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "cinder-quobyte-f87731d5-b5eb-4638-88e2-f29a720a0321" released by "delete_volume" :: held 0.764s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Created reservations ['4a246692-9249-4665-80d5-df95b8ee360f', '94836239-3f1e-4805-9d87-28094e9bf91f', '6175ae74-47de-4986-9cda-b00de9970da7', '98ee1385-01a5-4060-9620-0c6568b14988'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:40 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:18:40 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:41 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.info" returned: 0 in 0.285s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1af87f7f-220e-428a-b97e-ae3013d05334 tempest-VolumesSnapshotTestJSON-1687800320 None] Create snapshot completed successfully Nov 05 16:18:41 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.296s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:18:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Deleted volume successfully. Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8103048e-8f4c-4bc3-8342-05dc175e2c54 tempest-TestServerVolumeAttachScenarioOldVersion-519858088 None] Lock "cinder-f87731d5-b5eb-4638-88e2-f29a720a0321-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Flow 'volume_create_manager' (6b1a79f7-9f2f-462a-b908-68f7016b2fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9c6f0b-81a2-42fc-ad44-d987938beea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9c6f0b-81a2-42fc-ad44-d987938beea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1099128176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6883062c-5652-412a-9f2e-cea35902b3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be656bae38934f7a91d2873bda2fe931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:42Z,use_quota=True,user_id='f8263bc2cb34482b90e1361500909460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca49534-638f-4589-b115-f00fc05959d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca49534-638f-4589-b115-f00fc05959d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c633bfd6-8f8f-4947-92d2-1588f963f7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c633bfd6-8f8f-4947-92d2-1588f963f7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6883062c-5652-412a-9f2e-cea35902b3aa', 'volume_name': 'volume-6883062c-5652-412a-9f2e-cea35902b3aa', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40b2946-e29b-4229-9c0b-e00e9d412619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40b2946-e29b-4229-9c0b-e00e9d412619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035c6988-b830-40db-b189-d500fd9d2201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:42 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Volume 6883062c-5652-412a-9f2e-cea35902b3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6883062c-5652-412a-9f2e-cea35902b3aa', 'volume_size': 1} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1099128176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6883062c-5652-412a-9f2e-cea35902b3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be656bae38934f7a91d2873bda2fe931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:42Z,use_quota=True,user_id='f8263bc2cb34482b90e1361500909460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Creating volume 6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:18:42 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:42 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa 1073741824 Nov 05 16:18:42 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:42 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa 1073741824" returned: 0 in 0.721s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:42 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa Nov 05 16:18:42 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (880963ac-6a47-4bda-8a7a-923b1e13dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c72359d-f05c-4f90-9513-6a52f87f0e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c72359d-f05c-4f90-9513-6a52f87f0e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-634892254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98eed93-c3cd-4187-9592-c96f6d2b6fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dc5d2846-fca3-4f0c-9a6a-574127322caa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:18:43Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d2b8de-4b69-4c1f-8fe9-c849ca66f4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d2b8de-4b69-4c1f-8fe9-c849ca66f4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfcbcf9-e76b-49ea-b768-07df3ef8e248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfcbcf9-e76b-49ea-b768-07df3ef8e248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b98eed93-c3cd-4187-9592-c96f6d2b6fcd', 'volume_name': 'volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd', 'volume_size': 2, 'snapshot_id': 'dc5d2846-fca3-4f0c-9a6a-574127322caa'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13512a99-1ae3-4898-8223-1624484a8aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13512a99-1ae3-4898-8223-1624484a8aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3815f94e-cb51-4a62-817c-b74bac8b4434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Volume b98eed93-c3cd-4187-9592-c96f6d2b6fcd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd', 'volume_size': 2, 'snapshot_id': 'dc5d2846-fca3-4f0c-9a6a-574127322caa'} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:43 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa" returned: 0 in 0.361s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.207s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-dc5d2846-fca3-4f0c-9a6a-574127322caa-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035c6988-b830-40db-b189-d500fd9d2201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6883062c-5652-412a-9f2e-cea35902b3aa', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861dcec7-bee7-4c4a-9bc8-93292b6f7777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Volume volume-6883062c-5652-412a-9f2e-cea35902b3aa (6883062c-5652-412a-9f2e-cea35902b3aa): created successfully Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (861dcec7-bee7-4c4a-9bc8-93292b6f7777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Flow 'volume_create_manager' (6b1a79f7-9f2f-462a-b908-68f7016b2fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-dc5d2846-fca3-4f0c-9a6a-574127322caa-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Creating volume b98eed93-c3cd-4187-9592-c96f6d2b6fcd from snapshot dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-212a2351-8477-4de2-afa3-8a1f18bb2c25 tempest-TestStampPattern-1800395907 None] Created volume successfully. Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] snapshot: dc5d2846-fca3-4f0c-9a6a-574127322caa, volume: b98eed93-c3cd-4187-9592-c96f6d2b6fcd, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe23229a-b346-43ec-b250-c4004134491b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:43 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa Nov 05 16:18:43 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:43 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa" returned: 0 in 0.508s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49bf3d6-bc3a-400c-b25b-b14ce6150028]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:44 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 Nov 05 16:18:44 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:44 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" returned: 0 in 0.483s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:18:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:18:44 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:18:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:44 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd Nov 05 16:18:44 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:18:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:50 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:18:50 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:51 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.822s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:51 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:18:51 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:18:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:18:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:18:53 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=35,cinder:SELECT=42,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:18:53 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=40,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:18:54 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" returned: 0 in 10.266s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:54 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61, size 1024.00 MB, duration 10.27 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:18:54 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Converted 1024.00 MB image at 99.73 MB/s Nov 05 16:18:54 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd is being set with open permissions: ugo+rw Nov 05 16:18:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:54 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd Nov 05 16:18:54 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:54 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" returned: 0 in 0.258s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" released by "_copy_volume_from_snapshot" :: held 11.619s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-dc5d2846-fca3-4f0c-9a6a-574127322caa-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" released by "_create_volume_from_snapshot" :: held 11.699s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.748s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3815f94e-cb51-4a62-817c-b74bac8b4434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd', 'volume_size': 2, 'snapshot_id': 'dc5d2846-fca3-4f0c-9a6a-574127322caa'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051f216d-726b-4fb6-b973-3cde25736cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:18:55 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Volume volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd (b98eed93-c3cd-4187-9592-c96f6d2b6fcd): created successfully Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051f216d-726b-4fb6-b973-3cde25736cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (880963ac-6a47-4bda-8a7a-923b1e13dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:18:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-aab55874-9ad7-42d8-8aa6-e1ac1d48b7ba tempest-VolumesSnapshotTestJSON-1687800320 None] Created volume successfully. Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-b98eed93-c3cd-4187-9592-c96f6d2b6fcd-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-b98eed93-c3cd-4187-9592-c96f6d2b6fcd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" acquired by "delete_volume" :: waited 0.066s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f3d1f9-bab3-4eae-b9e7-aa9770c6c530]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:55 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd Nov 05 16:18:55 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:56 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" returned: 0 in 0.506s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:56 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd Nov 05 16:18:56 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:56 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" returned: 0 in 0.448s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-b98eed93-c3cd-4187-9592-c96f6d2b6fcd" released by "delete_volume" :: held 1.122s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['c6b6cbf8-13b0-46f6-a5b9-b4a726ba7030', '1ffc7480-190c-4248-bc3b-c72b6f0c1c42', '408fc578-6ccb-4312-98f2-e63a24bbe9c1', '4178629e-b691-4f36-ae52-de10e2b825eb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:18:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:56 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:18:56 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:57 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.274s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:57 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:18:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Deleted volume successfully. Nov 05 16:18:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-90be545b-cc5e-44d3-834f-eba2719649d9 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-b98eed93-c3cd-4187-9592-c96f6d2b6fcd-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-dc5d2846-fca3-4f0c-9a6a-574127322caa-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-dc5d2846-fca3-4f0c-9a6a-574127322caa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-dc5d2846-fca3-4f0c-9a6a-574127322caa" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-dc5d2846-fca3-4f0c-9a6a-574127322caa" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Deleting offline snapshot dc5d2846-fca3-4f0c-9a6a-574127322caa of volume 94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] snapshot_file for this snap is: volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d350d494-3979-4721-ac05-c17f30c0c14b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:58 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa Nov 05 16:18:58 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:58 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa" returned: 0 in 0.650s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab0c40-4845-4072-b1ae-b839d00f3624]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:18:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:59 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 Nov 05 16:18:59 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:59 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" returned: 0 in 0.713s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:59 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa Nov 05 16:18:59 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:18:59 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Nov 05 16:18:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa" returned: 0 in 0.364s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:18:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:18:59 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa Nov 05 16:18:59 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:00 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61.dc5d2846-fca3-4f0c-9a6a-574127322caa" returned: 0 in 0.320s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-dc5d2846-fca3-4f0c-9a6a-574127322caa" released by "_delete_snapshot" :: held 2.203s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" released by "delete_snapshot" :: held 2.240s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:00 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['0fdc9a67-d2ea-4004-82e7-4f5910da8c50', '74715520-5b1f-4aa6-84e6-0d7f41ee39fe', '2991a06e-1c9a-436f-9abf-0b15f9773f6d', '22644df3-1ede-4384-964b-1f7cc233d7c3'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:19:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Delete snapshot completed successfully. Nov 05 16:19:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e54c05ab-8ce5-46d5-9927-dcd49460551d tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-dc5d2846-fca3-4f0c-9a6a-574127322caa-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" acquired by "delete_volume" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:01 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dd78eb-85fd-4fc3-9338-2e81510605db]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:01 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 Nov 05 16:19:01 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:02 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:02 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61 Nov 05 16:19:02 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:02 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" returned: 0 in 0.290s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61" released by "delete_volume" :: held 0.773s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['09d0b1ae-c845-4540-bcbe-8908579ab676', '1e6730d8-1571-4869-a130-b58ed13086fa', '6592fae7-f8a8-48d9-9141-5e85d228ae24', 'ca55be7d-1e69-4671-ab09-0f9702fdd38a'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:02 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:19:02 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:02 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.335s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:19:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Deleted volume successfully. Nov 05 16:19:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7057dfed-f8b8-43f9-a6db-04a535c5dd52 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-94f0fc14-1a1f-4a50-b135-5a38d7e1ed61-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (01a45eac-51b6-48c8-bc8d-5f2b3d14b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bae434c-d77d-4c9f-8f4d-447ed2d577c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bae434c-d77d-4c9f-8f4d-447ed2d577c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1665808595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d996e9c4-4ebe-4552-9de7-e90db0b270fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:03Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013d027c-e6e1-4d0d-81a2-66f55808638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013d027c-e6e1-4d0d-81a2-66f55808638b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877c1b58-4acb-4881-85ed-7069f688c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877c1b58-4acb-4881-85ed-7069f688c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd996e9c4-4ebe-4552-9de7-e90db0b270fa', 'volume_name': 'volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7dfdd-bd16-48ce-87c3-69456d381273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7dfdd-bd16-48ce-87c3-69456d381273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158b728b-b4e7-453c-b3d0-9f0b8bf1a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:03 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume d996e9c4-4ebe-4552-9de7-e90db0b270fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa', 'volume_size': 1} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1665808595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d996e9c4-4ebe-4552-9de7-e90db0b270fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:03Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Creating volume d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:19:03 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:19:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:03 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa 1073741824 Nov 05 16:19:03 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:04 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa 1073741824" returned: 0 in 0.524s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:04 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa Nov 05 16:19:04 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:04 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa" returned: 0 in 0.317s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158b728b-b4e7-453c-b3d0-9f0b8bf1a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5daa14-f827-44e9-a36c-600906fb5293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:04 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Volume volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa (d996e9c4-4ebe-4552-9de7-e90db0b270fa): created successfully Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5daa14-f827-44e9-a36c-600906fb5293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:04 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (01a45eac-51b6-48c8-bc8d-5f2b3d14b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:04 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8693793b-6e58-4e84-bee3-bd55fdef9e53 tempest-VolumesSnapshotTestJSON-1687800320 None] Created volume successfully. Nov 05 16:19:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Creating offline snapshot d8788702-4477-4a14-845a-d44a31816511 of volume d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:19:05 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dba0c0-dae8-451a-b177-72abfbb4e17a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:05 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa Nov 05 16:19:05 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:06 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa" returned: 0 in 0.386s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:06 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 1G Nov 05 16:19:06 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:06 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 1G" returned: 0 in 0.451s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:06 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 Nov 05 16:19:06 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:06 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511" returned: 0 in 0.305s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:06 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 is being set with open permissions: ugo+rw Nov 05 16:19:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:06 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 Nov 05 16:19:06 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:07 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:07 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.info Nov 05 16:19:07 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:07 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.info" returned: 0 in 0.271s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:07 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.info is being set with open permissions: ugo+rw Nov 05 16:19:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:07 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.info Nov 05 16:19:07 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:07 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.info" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c4be2519-7c1c-4cc0-a0b7-98f7e161f860 tempest-VolumesSnapshotTestJSON-1687800320 None] Create snapshot completed successfully Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (3f66e5f4-7357-485c-a5cb-652d31a09b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7806a12a-0368-49fd-a9f5-75da76a1b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7806a12a-0368-49fd-a9f5-75da76a1b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1485966855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3272a9-bdb2-4cc9-8629-539519c8ed27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cacf75b3f0e448fa46adec1efe350c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8788702-4477-4a14-845a-d44a31816511,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:09Z,use_quota=True,user_id='3bba814bbbc6483cbeb81b97358b7aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ca7eb6-56b3-422f-bb8e-2810d8406503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ca7eb6-56b3-422f-bb8e-2810d8406503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35857627-400e-4e93-8a0a-714b9dae7621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35857627-400e-4e93-8a0a-714b9dae7621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f3272a9-bdb2-4cc9-8629-539519c8ed27', 'volume_name': 'volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27', 'volume_size': 1, 'snapshot_id': 'd8788702-4477-4a14-845a-d44a31816511'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5367b2a7-1586-4ef7-b828-0d2673bc4da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5367b2a7-1586-4ef7-b828-0d2673bc4da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa75c30-e1b0-45c1-85e0-cffd0a6831cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:09 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Volume 6f3272a9-bdb2-4cc9-8629-539519c8ed27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27', 'volume_size': 1, 'snapshot_id': 'd8788702-4477-4a14-845a-d44a31816511'} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-d8788702-4477-4a14-845a-d44a31816511-6f3272a9-bdb2-4cc9-8629-539519c8ed27" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d8788702-4477-4a14-845a-d44a31816511-6f3272a9-bdb2-4cc9-8629-539519c8ed27" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Creating volume 6f3272a9-bdb2-4cc9-8629-539519c8ed27 from snapshot d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-6f3272a9-bdb2-4cc9-8629-539519c8ed27" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-6f3272a9-bdb2-4cc9-8629-539519c8ed27" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] snapshot: d8788702-4477-4a14-845a-d44a31816511, volume: 6f3272a9-bdb2-4cc9-8629-539519c8ed27, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b172541-1c6f-4602-a47d-5931ec072ec0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:09 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 Nov 05 16:19:09 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:10 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511" returned: 0 in 0.390s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b81d3-ce20-41bf-94ae-a66cb64f2eeb]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:10 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa Nov 05 16:19:10 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:10 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa" returned: 0 in 0.393s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:19:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:10 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 Nov 05 16:19:10 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:19 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27" returned: 0 in 8.700s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa, size 1024.00 MB, duration 8.70 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:19:19 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Converted 1024.00 MB image at 117.69 MB/s Nov 05 16:19:19 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 is being set with open permissions: ugo+rw Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:19 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 Nov 05 16:19:19 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:19:19 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27" returned: 0 in 0.343s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-6f3272a9-bdb2-4cc9-8629-539519c8ed27" released by "_copy_volume_from_snapshot" :: held 9.942s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-76b1825a-7292-4711-8840-5aaf833f0016 req-f888ce4b-fa45-4759-8cef-7ad9bb9b1556 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d8788702-4477-4a14-845a-d44a31816511-6f3272a9-bdb2-4cc9-8629-539519c8ed27" released by "_create_volume_from_snapshot" :: held 10.044s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.086s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-76b1825a-7292-4711-8840-5aaf833f0016 req-f888ce4b-fa45-4759-8cef-7ad9bb9b1556 tempest-TestStampPattern-1800395907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.033s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-76b1825a-7292-4711-8840-5aaf833f0016 req-f888ce4b-fa45-4759-8cef-7ad9bb9b1556 tempest-TestStampPattern-1800395907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa75c30-e1b0-45c1-85e0-cffd0a6831cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27', 'volume_size': 1, 'snapshot_id': 'd8788702-4477-4a14-845a-d44a31816511'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c80f3b-adc8-4035-af29-1fc402496f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Volume volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 (6f3272a9-bdb2-4cc9-8629-539519c8ed27): created successfully Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c80f3b-adc8-4035-af29-1fc402496f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Flow 'volume_create_manager' (3f66e5f4-7357-485c-a5cb-652d31a09b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-76b1825a-7292-4711-8840-5aaf833f0016 req-f888ce4b-fa45-4759-8cef-7ad9bb9b1556 tempest-TestStampPattern-1800395907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-6883062c-5652-412a-9f2e-cea35902b3aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42ad2cf8-f62b-4f99-b44e-fd89196e7cad', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:19:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bf21fcf8-abff-40ff-88d3-afcdd85197bb tempest-VolumesSnapshotTestJSON-1687800320 None] Created volume successfully. Nov 05 16:19:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-76b1825a-7292-4711-8840-5aaf833f0016 req-f888ce4b-fa45-4759-8cef-7ad9bb9b1556 tempest-TestStampPattern-1800395907 None] attachment_update completed successfully. Nov 05 16:19:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-6f3272a9-bdb2-4cc9-8629-539519c8ed27-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-6f3272a9-bdb2-4cc9-8629-539519c8ed27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-6f3272a9-bdb2-4cc9-8629-539519c8ed27" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-6f3272a9-bdb2-4cc9-8629-539519c8ed27" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6faaf-80e9-44ab-9159-29aa1e1286af]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:20 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 Nov 05 16:19:20 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:21 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27" returned: 0 in 0.406s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:21 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27 Nov 05 16:19:21 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:21 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6f3272a9-bdb2-4cc9-8629-539519c8ed27" returned: 0 in 0.270s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-6f3272a9-bdb2-4cc9-8629-539519c8ed27" released by "delete_volume" :: held 0.730s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['129df074-7457-43db-b471-645cef1bdaff', '4707fae7-d210-4212-a817-60f69cf5c9e2', 'e9dd65fe-701c-4284-9e95-564e134c8bc8', 'ba6112d7-ee65-43c4-b6a1-7ee5ead429ea'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:21 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:19:21 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-d8788702-4477-4a14-845a-d44a31816511-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-d8788702-4477-4a14-845a-d44a31816511-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-d996e9c4-4ebe-4552-9de7-e90db0b270fa" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d996e9c4-4ebe-4552-9de7-e90db0b270fa" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-d8788702-4477-4a14-845a-d44a31816511" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:22 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.315s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d8788702-4477-4a14-845a-d44a31816511" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Deleting offline snapshot d8788702-4477-4a14-845a-d44a31816511 of volume d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] snapshot_file for this snap is: volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:19:22 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Deleted volume successfully. Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03f6ad-67e1-4f3a-9d3e-d2e4e11c46d4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-563cdbe8-07fa-4c7a-9685-ae562c7df6bd tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-6f3272a9-bdb2-4cc9-8629-539519c8ed27-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:22 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 Nov 05 16:19:22 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:22 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511" returned: 0 in 0.409s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3a4722-f309-4d97-aa26-4b7d357dae8d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:22 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa Nov 05 16:19:22 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:23 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa" returned: 0 in 0.640s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:23 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 Nov 05 16:19:23 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:23 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511" returned: 0 in 0.412s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:23 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511 Nov 05 16:19:23 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:23 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa.d8788702-4477-4a14-845a-d44a31816511" returned: 0 in 0.335s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d8788702-4477-4a14-845a-d44a31816511" released by "_delete_snapshot" :: held 1.937s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d996e9c4-4ebe-4552-9de7-e90db0b270fa" released by "delete_snapshot" :: held 1.981s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:24 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['31ca50e8-6e8d-4a99-99f4-0fd8066c2eff', '08b6553a-28d0-461c-94d9-f8b11df773ad', '2314706a-e909-4308-8c4f-9fd8846e4e6c', 'cab37c77-1001-4afe-b85c-6be22129cac6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:19:24 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Delete snapshot completed successfully. Nov 05 16:19:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32e8852d-3b83-423d-b791-392b39e7b8c0 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-d8788702-4477-4a14-845a-d44a31816511-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-676d93b7-44d2-42f0-ba20-4edd8f5c0858 req-8568b7d5-26cc-44c2-8255-991f53b1a1d3 tempest-TestStampPattern-1800395907 None] Terminate volume connection completed successfully. Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-676d93b7-44d2-42f0-ba20-4edd8f5c0858 req-8568b7d5-26cc-44c2-8255-991f53b1a1d3 tempest-TestStampPattern-1800395907 None] Deleting attachment 42ad2cf8-f62b-4f99-b44e-fd89196e7cad. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-d996e9c4-4ebe-4552-9de7-e90db0b270fa-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-d996e9c4-4ebe-4552-9de7-e90db0b270fa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-d996e9c4-4ebe-4552-9de7-e90db0b270fa" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d996e9c4-4ebe-4552-9de7-e90db0b270fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b44b132-29f4-47c9-972c-3370588b5205]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:25 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa Nov 05 16:19:25 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:25 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa" returned: 0 in 0.422s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:25 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa Nov 05 16:19:25 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Creating offline snapshot 7fcc9b3b-58fb-448c-8b5c-e12344aa1908 of volume 6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b94f52a-f87b-4d10-af88-d0e47a659a77]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:26 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d996e9c4-4ebe-4552-9de7-e90db0b270fa" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-d996e9c4-4ebe-4552-9de7-e90db0b270fa" released by "delete_volume" :: held 0.858s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:26 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa Nov 05 16:19:26 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['3ce27a6b-72c3-40d3-8d73-ba83a2320a58', '687405df-2041-433a-8fe5-01ff5cf2a4f1', 'e02c34fb-62fc-4391-a543-818160313494', '365fcfb9-6bc1-4f50-aaca-1010030b91e2'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:26 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:19:26 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-258271f0-2e38-4975-879d-7dcd66d052ae-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-258271f0-2e38-4975-879d-7dcd66d052ae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "cinder-quobyte-258271f0-2e38-4975-879d-7dcd66d052ae" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-258271f0-2e38-4975-879d-7dcd66d052ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:26 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa" returned: 0 in 0.643s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b8271-7f20-4f17-bf6e-95d5e9815c04]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:26 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 1G Nov 05 16:19:26 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:26 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.414s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:19:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Deleted volume successfully. Nov 05 16:19:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5dfbaaf-8458-4485-99cd-c543054ea3cb tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-d996e9c4-4ebe-4552-9de7-e90db0b270fa-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:26 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae Nov 05 16:19:26 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:27 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae" returned: 0 in 0.500s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:27 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 1G" returned: 0 in 0.549s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6883062c-5652-412a-9f2e-cea35902b3aa -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:27 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae Nov 05 16:19:27 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:27 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6883062c-5652-412a-9f2e-cea35902b3aa -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 Nov 05 16:19:27 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:27 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-258271f0-2e38-4975-879d-7dcd66d052ae" returned: 0 in 0.334s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-quobyte-258271f0-2e38-4975-879d-7dcd66d052ae" released by "delete_volume" :: held 0.928s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:27 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6883062c-5652-412a-9f2e-cea35902b3aa -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908" returned: 0 in 0.368s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:27 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 is being set with open permissions: ugo+rw Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Created reservations ['3385a00c-e68e-4eb0-b110-bb73c49744a1', 'd3a5cab4-bed4-4b31-8aa9-938b03e240dd', '2b22e208-4e3e-4543-ad19-18ebb701c333', 'c84a8149-8801-4ea8-9917-50c290868bc1'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:19:27 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 Nov 05 16:19:27 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:27 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:19:27 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:28 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908" returned: 0 in 0.339s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:28 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.info Nov 05 16:19:28 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:28 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.296s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:19:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Deleted volume successfully. Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b82f21-0151-4000-8366-85d1576517d6 tempest-VolumesSnapshotTestJSON-1687800320 None] Lock "cinder-258271f0-2e38-4975-879d-7dcd66d052ae-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:28 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.info" returned: 0 in 0.276s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:28 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.info is being set with open permissions: ugo+rw Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:28 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.info Nov 05 16:19:28 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:28 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.info" returned: 0 in 0.269s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-98054e7c-bec3-438a-be34-015550054e73 tempest-TestStampPattern-1800395907 None] Create snapshot completed successfully Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Flow 'volume_create_manager' (47b9ca66-254e-47f7-a85b-29b8e5bfbef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2501a565-8041-41f5-9bda-1b3fb9088daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2501a565-8041-41f5-9bda-1b3fb9088daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2121945665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779b6fb1-da37-4328-80c2-f5ee400dff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef9e32b1374dd7af281caff11d4374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:31Z,use_quota=True,user_id='426d75169b6545ff826160b4f9507989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21e25c2-c4ac-474a-adf4-176ba1fa1024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21e25c2-c4ac-474a-adf4-176ba1fa1024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf27632-b6e4-45b6-a0d8-c88d1f7c9830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf27632-b6e4-45b6-a0d8-c88d1f7c9830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779b6fb1-da37-4328-80c2-f5ee400dff6d', 'volume_name': 'volume-779b6fb1-da37-4328-80c2-f5ee400dff6d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de3a829-17d1-455f-94dd-405b2d34ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de3a829-17d1-455f-94dd-405b2d34ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4eeefc3-d00b-4d07-9580-15be1d0dfa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Volume 779b6fb1-da37-4328-80c2-f5ee400dff6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779b6fb1-da37-4328-80c2-f5ee400dff6d', 'volume_size': 1} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2121945665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779b6fb1-da37-4328-80c2-f5ee400dff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef9e32b1374dd7af281caff11d4374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:31Z,use_quota=True,user_id='426d75169b6545ff826160b4f9507989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Creating volume 779b6fb1-da37-4328-80c2-f5ee400dff6d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:19:31 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:31 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d 1073741824 Nov 05 16:19:31 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Flow 'volume_create_manager' (0ac7733d-c3e4-489b-89a9-8dbf23b6c7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7d4f30-2ec8-41aa-8bfa-96a29f687d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7d4f30-2ec8-41aa-8bfa-96a29f687d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-484231799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8771e638-ca96-45cd-a28d-e59e2f2446b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef9e32b1374dd7af281caff11d4374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:32Z,use_quota=True,user_id='426d75169b6545ff826160b4f9507989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd17a4d2-204a-4d15-a21d-6433ed14f54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd17a4d2-204a-4d15-a21d-6433ed14f54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc9be44-bc12-434c-b582-034ea2e53032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc9be44-bc12-434c-b582-034ea2e53032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8771e638-ca96-45cd-a28d-e59e2f2446b6', 'volume_name': 'volume-8771e638-ca96-45cd-a28d-e59e2f2446b6', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98efe66d-2e7a-476d-a05a-8eda2e0a8c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98efe66d-2e7a-476d-a05a-8eda2e0a8c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ece94c-6780-4209-9336-d92d69c036e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Volume 8771e638-ca96-45cd-a28d-e59e2f2446b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8771e638-ca96-45cd-a28d-e59e2f2446b6', 'volume_size': 1} Nov 05 16:19:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:32 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d 1073741824" returned: 0 in 0.716s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:32 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d Nov 05 16:19:32 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:32 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d" returned: 0 in 0.281s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-484231799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8771e638-ca96-45cd-a28d-e59e2f2446b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ef9e32b1374dd7af281caff11d4374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:32Z,use_quota=True,user_id='426d75169b6545ff826160b4f9507989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Creating volume 8771e638-ca96-45cd-a28d-e59e2f2446b6 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:19:32 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4eeefc3-d00b-4d07-9580-15be1d0dfa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779b6fb1-da37-4328-80c2-f5ee400dff6d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:32 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 1073741824 Nov 05 16:19:32 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9852a6-3761-4e70-881d-27352c7e8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:32 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Volume volume-779b6fb1-da37-4328-80c2-f5ee400dff6d (779b6fb1-da37-4328-80c2-f5ee400dff6d): created successfully Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9852a6-3761-4e70-881d-27352c7e8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Flow 'volume_create_manager' (47b9ca66-254e-47f7-a85b-29b8e5bfbef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-812f6578-375d-4432-ace2-6a826bdfff44 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Created volume successfully. Nov 05 16:19:33 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 1073741824" returned: 0 in 0.593s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:33 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 Nov 05 16:19:33 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:33 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6" returned: 0 in 0.411s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ece94c-6780-4209-9336-d92d69c036e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8771e638-ca96-45cd-a28d-e59e2f2446b6', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098c6a12-b9a1-421c-b48d-4228c462d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Volume volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 (8771e638-ca96-45cd-a28d-e59e2f2446b6): created successfully Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098c6a12-b9a1-421c-b48d-4228c462d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Flow 'volume_create_manager' (0ac7733d-c3e4-489b-89a9-8dbf23b6c7f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-43a1aa82-5db6-4e99-9ee7-d1896fa67d63 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Created volume successfully. Nov 05 16:19:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:19:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Flow 'volume_create_manager' (27b9f901-d1d6-4c1b-9a38-2382ea969b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f48a4cb-053c-4213-8402-e7fe7b07d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f48a4cb-053c-4213-8402-e7fe7b07d17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1553470181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a70d13-620f-4511-b4cc-7098ab0b3e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be656bae38934f7a91d2873bda2fe931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7fcc9b3b-58fb-448c-8b5c-e12344aa1908,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:19:38Z,use_quota=True,user_id='f8263bc2cb34482b90e1361500909460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f282212-385a-4d9f-9f45-fc4d15d5e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f282212-385a-4d9f-9f45-fc4d15d5e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e2c901-35de-4dbf-98f1-55b1ee2ce480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e2c901-35de-4dbf-98f1-55b1ee2ce480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90a70d13-620f-4511-b4cc-7098ab0b3e54', 'volume_name': 'volume-90a70d13-620f-4511-b4cc-7098ab0b3e54', 'volume_size': 1, 'snapshot_id': '7fcc9b3b-58fb-448c-8b5c-e12344aa1908'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f8da4b-2df3-4086-8493-9fa552672992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f8da4b-2df3-4086-8493-9fa552672992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619492fb-f064-4ff3-a5cf-9d40c85148e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Volume 90a70d13-620f-4511-b4cc-7098ab0b3e54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90a70d13-620f-4511-b4cc-7098ab0b3e54', 'volume_size': 1, 'snapshot_id': '7fcc9b3b-58fb-448c-8b5c-e12344aa1908'} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-quobyte-7fcc9b3b-58fb-448c-8b5c-e12344aa1908-90a70d13-620f-4511-b4cc-7098ab0b3e54" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-7fcc9b3b-58fb-448c-8b5c-e12344aa1908-90a70d13-620f-4511-b4cc-7098ab0b3e54" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Creating volume 90a70d13-620f-4511-b4cc-7098ab0b3e54 from snapshot 7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-quobyte-90a70d13-620f-4511-b4cc-7098ab0b3e54" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-90a70d13-620f-4511-b4cc-7098ab0b3e54" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] snapshot: 7fcc9b3b-58fb-448c-8b5c-e12344aa1908, volume: 90a70d13-620f-4511-b4cc-7098ab0b3e54, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311b3a4-1582-463d-9bcf-7ef592803bbc]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:38 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 Nov 05 16:19:38 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:38 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908" returned: 0 in 0.418s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6883062c-5652-412a-9f2e-cea35902b3aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e781ceec-10e8-4a2d-bd28-51ec5f1b58ab]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:19:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:38 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa Nov 05 16:19:38 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:39 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa" returned: 0 in 0.422s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:19:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:19:39 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:19:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:39 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 Nov 05 16:19:39 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:48 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=69,cinder:SELECT=69,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:19:48 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=34,cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:19:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:19:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:19:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:19:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:19:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:19:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:50 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:19:50 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:51 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.932s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:19:51 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54" returned: 0 in 12.424s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa, size 1024.00 MB, duration 12.43 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:19:51 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Converted 1024.00 MB image at 82.40 MB/s Nov 05 16:19:51 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 is being set with open permissions: ugo+rw Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:19:51 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 Nov 05 16:19:51 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:19:51 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:19:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-90a70d13-620f-4511-b4cc-7098ab0b3e54" released by "_copy_volume_from_snapshot" :: held 13.847s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-7fcc9b3b-58fb-448c-8b5c-e12344aa1908-90a70d13-620f-4511-b4cc-7098ab0b3e54" released by "_create_volume_from_snapshot" :: held 13.998s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:19:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.036s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:19:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619492fb-f064-4ff3-a5cf-9d40c85148e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a70d13-620f-4511-b4cc-7098ab0b3e54', 'volume_size': 1, 'snapshot_id': '7fcc9b3b-58fb-448c-8b5c-e12344aa1908'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264fc6ce-9b42-461a-8322-825b9d880a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:19:52 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Volume volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 (90a70d13-620f-4511-b4cc-7098ab0b3e54): created successfully Nov 05 16:19:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264fc6ce-9b42-461a-8322-825b9d880a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:19:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Flow 'volume_create_manager' (27b9f901-d1d6-4c1b-9a38-2382ea969b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:19:52 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-cfea585a-f775-4348-a880-dd597b4d4c87 tempest-TestStampPattern-1800395907 None] Created volume successfully. Nov 05 16:20:02 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:20:02 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=2,cinder:INSERT=1,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:20:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-64164802-29a8-4db2-a80a-81c31bc8fd82 req-3febca09-b529-4a42-9b66-66f1369967d0 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-64164802-29a8-4db2-a80a-81c31bc8fd82 req-3febca09-b529-4a42-9b66-66f1369967d0 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-64164802-29a8-4db2-a80a-81c31bc8fd82 req-3febca09-b529-4a42-9b66-66f1369967d0 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-64164802-29a8-4db2-a80a-81c31bc8fd82 req-3febca09-b529-4a42-9b66-66f1369967d0 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-779b6fb1-da37-4328-80c2-f5ee400dff6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1226bfe8-6b6e-497f-bff6-5107091ce565', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:20:08 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-64164802-29a8-4db2-a80a-81c31bc8fd82 req-3febca09-b529-4a42-9b66-66f1369967d0 tempest-TestServerVolumeAttachmentScenario-1723448491 None] attachment_update completed successfully. Nov 05 16:20:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-1685528c-6134-49d6-a0e7-9cd2606347f2 req-09566169-ba9b-43c8-8bfb-45cf5c9afdca tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-1685528c-6134-49d6-a0e7-9cd2606347f2 req-09566169-ba9b-43c8-8bfb-45cf5c9afdca tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-1685528c-6134-49d6-a0e7-9cd2606347f2 req-09566169-ba9b-43c8-8bfb-45cf5c9afdca tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-1685528c-6134-49d6-a0e7-9cd2606347f2 req-09566169-ba9b-43c8-8bfb-45cf5c9afdca tempest-TestServerVolumeAttachmentScenario-1723448491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-8771e638-ca96-45cd-a28d-e59e2f2446b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '099ff23f-edf3-48f7-b99a-0742ad8773ea', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:20:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-1685528c-6134-49d6-a0e7-9cd2606347f2 req-09566169-ba9b-43c8-8bfb-45cf5c9afdca tempest-TestServerVolumeAttachmentScenario-1723448491 None] attachment_update completed successfully. Nov 05 16:20:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-275aee67-5400-46ae-b5ea-e180c1c00503 req-36f7e07d-b08d-467d-96ee-f0e5d1111537 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Terminate volume connection completed successfully. Nov 05 16:20:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-275aee67-5400-46ae-b5ea-e180c1c00503 req-36f7e07d-b08d-467d-96ee-f0e5d1111537 tempest-TestServerVolumeAttachmentScenario-1723448491 None] Deleting attachment 099ff23f-edf3-48f7-b99a-0742ad8773ea. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Flow 'volume_create_manager' (3790acac-7ecf-4871-9076-27909602f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154aaace-963f-4ff5-a7af-39e6fad2a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154aaace-963f-4ff5-a7af-39e6fad2a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1298527445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60346b7-670e-4b8f-8318-00c1562df1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c127e0f7df4e7e93fc2a9cbd8a1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:15Z,use_quota=True,user_id='220515193efe474683b6e1d741de053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bacb2ea6-986a-48a1-93ea-7bcc1907140a),volume_type_id=bacb2ea6-986a-48a1-93ea-7bcc1907140a)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86877756-2c60-46fc-86f6-20c209948656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86877756-2c60-46fc-86f6-20c209948656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6939aab4-1760-4e42-bd2b-dec994898149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6939aab4-1760-4e42-bd2b-dec994898149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60346b7-670e-4b8f-8318-00c1562df1d9', 'volume_name': 'volume-c60346b7-670e-4b8f-8318-00c1562df1d9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f35ea4e-49fa-4637-8b0b-4b455b34e775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f35ea4e-49fa-4637-8b0b-4b455b34e775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0882e1f-6d51-4a7d-9872-5728405d5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Volume c60346b7-670e-4b8f-8318-00c1562df1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60346b7-670e-4b8f-8318-00c1562df1d9', 'volume_size': 1} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1298527445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60346b7-670e-4b8f-8318-00c1562df1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c127e0f7df4e7e93fc2a9cbd8a1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:15Z,use_quota=True,user_id='220515193efe474683b6e1d741de053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bacb2ea6-986a-48a1-93ea-7bcc1907140a),volume_type_id=bacb2ea6-986a-48a1-93ea-7bcc1907140a)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Creating volume c60346b7-670e-4b8f-8318-00c1562df1d9 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:20:15 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:20:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:15 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 1073741824 Nov 05 16:20:15 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-5fc39556-b9f9-4edd-acb4-06eda39df76a req-bd8af609-2fb7-4295-a003-70d641649f7c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Terminate volume connection completed successfully. Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-5fc39556-b9f9-4edd-acb4-06eda39df76a req-bd8af609-2fb7-4295-a003-70d641649f7c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Deleting attachment 1226bfe8-6b6e-497f-bff6-5107091ce565. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Flow 'volume_create_manager' (26483838-d3f8-4be1-8585-e55fd714a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e78e37-bf23-4368-a37d-f4c97dcb39af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e78e37-bf23-4368-a37d-f4c97dcb39af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-407589892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb711e2-85ae-4b3e-afe8-8f180b55e694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c127e0f7df4e7e93fc2a9cbd8a1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:16Z,use_quota=True,user_id='220515193efe474683b6e1d741de053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3340a0d-2bb8-4c11-a9a5-759f792d3d84),volume_type_id=e3340a0d-2bb8-4c11-a9a5-759f792d3d84)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c11ff7-7602-49b1-9d88-ae392bfebfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c11ff7-7602-49b1-9d88-ae392bfebfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e5f5bc-1913-4d83-82c8-91a7182dfc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e5f5bc-1913-4d83-82c8-91a7182dfc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb711e2-85ae-4b3e-afe8-8f180b55e694', 'volume_name': 'volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa16518-59c0-4c95-9d70-8a8193ac6630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa16518-59c0-4c95-9d70-8a8193ac6630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a200d12-0a50-4bb4-869e-ffff8a78736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Volume ccb711e2-85ae-4b3e-afe8-8f180b55e694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694', 'volume_size': 1} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:16 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 1073741824" returned: 0 in 0.574s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:16 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 Nov 05 16:20:16 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:16 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9" returned: 0 in 0.279s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-407589892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb711e2-85ae-4b3e-afe8-8f180b55e694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c127e0f7df4e7e93fc2a9cbd8a1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:16Z,use_quota=True,user_id='220515193efe474683b6e1d741de053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3340a0d-2bb8-4c11-a9a5-759f792d3d84),volume_type_id=e3340a0d-2bb8-4c11-a9a5-759f792d3d84)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Creating volume ccb711e2-85ae-4b3e-afe8-8f180b55e694 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:20:16 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0882e1f-6d51-4a7d-9872-5728405d5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60346b7-670e-4b8f-8318-00c1562df1d9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f8d6bf-9a33-4d47-9811-465708df663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 1073741824 Nov 05 16:20:16 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Volume volume-c60346b7-670e-4b8f-8318-00c1562df1d9 (c60346b7-670e-4b8f-8318-00c1562df1d9): created successfully Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f8d6bf-9a33-4d47-9811-465708df663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Flow 'volume_create_manager' (3790acac-7ecf-4871-9076-27909602f359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1ebeaab7-54f0-4ff5-a709-a546d11582df tempest-TestInstancesWithCinderVolumes-329544364 None] Created volume successfully. Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Flow 'volume_create_manager' (fe02e44d-a223-4085-b711-143a5df8997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeb0d45-4ee5-4d9a-b94d-b627861830c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aeb0d45-4ee5-4d9a-b94d-b627861830c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1974812494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf5cc51-566b-4518-a388-36e35852968d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c127e0f7df4e7e93fc2a9cbd8a1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:17Z,use_quota=True,user_id='220515193efe474683b6e1d741de053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e481d611-4ec3-41d7-bb60-3a96ce5c8811),volume_type_id=e481d611-4ec3-41d7-bb60-3a96ce5c8811)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea160b49-c0f2-4aa7-b627-903012b7e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea160b49-c0f2-4aa7-b627-903012b7e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b46541-344e-4df8-bff0-f84dd0965f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:16 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:20:17 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 1073741824" returned: 0 in 0.598s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b46541-344e-4df8-bff0-f84dd0965f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bf5cc51-566b-4518-a388-36e35852968d', 'volume_name': 'volume-0bf5cc51-566b-4518-a388-36e35852968d', 'volume_size': 1, 'image_id': '86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--281327886', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2c127e0f7df4e7e93fc2a9cbd8a1cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'created_at': datetime.datetime(2026, 11, 5, 15, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c/file', 'properties': {}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da149473-5632-4364-976b-1fbf3b2b9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da149473-5632-4364-976b-1fbf3b2b9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b351080c-7525-40dc-8a7c-948004a9552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Volume 0bf5cc51-566b-4518-a388-36e35852968d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bf5cc51-566b-4518-a388-36e35852968d', 'volume_size': 1, 'image_id': '86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--281327886', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2c127e0f7df4e7e93fc2a9cbd8a1cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'created_at': datetime.datetime(2026, 11, 5, 15, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c/file', 'properties': {}}, 'image_service': } Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Trying to clone 0bf5cc51-566b-4518-a388-36e35852968d from image 86c0acf1-4416-4696-9c8e-ecf0486ba73c at location (None, [{'url': 'file:///opt/stack/data/glance/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:17 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 Nov 05 16:20:17 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:17 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694" returned: 0 in 0.478s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a200d12-0a50-4bb4-869e-ffff8a78736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b42014-48ee-4d64-b524-fd285777b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Volume volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 (ccb711e2-85ae-4b3e-afe8-8f180b55e694): created successfully Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b42014-48ee-4d64-b524-fd285777b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Flow 'volume_create_manager' (26483838-d3f8-4be1-8585-e55fd714a20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-580c4c05-f3bc-49a6-b8b9-93138cb2cfc9 tempest-TestInstancesWithCinderVolumes-329544364 None] Created volume successfully. Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "cinder-8771e638-ca96-45cd-a28d-e59e2f2446b6-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-8771e638-ca96-45cd-a28d-e59e2f2446b6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "cinder-quobyte-8771e638-ca96-45cd-a28d-e59e2f2446b6" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-quobyte-8771e638-ca96-45cd-a28d-e59e2f2446b6" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e21c2-f1f4-4aa6-907e-5f109769f109]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:20 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 Nov 05 16:20:20 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD, size 20.69 MB, duration 3.68 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:20:20 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Image download 20.69 MB at 5.62 MB/s Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ebba7a-de13-41ec-9a34-13a921de4647]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:21 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD Nov 05 16:20:21 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:21 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:21 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6 Nov 05 16:20:21 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:21 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Temporary image 86c0acf1-4416-4696-9c8e-ecf0486ba73c is fetched for user 220515193efe474683b6e1d741de053d. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:20:21 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8771e638-ca96-45cd-a28d-e59e2f2446b6" returned: 0 in 0.249s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-quobyte-8771e638-ca96-45cd-a28d-e59e2f2446b6" released by "delete_volume" :: held 0.679s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642c003-5581-4793-80a3-21d17ee63979]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Created reservations ['5f6c7987-2ba4-47b0-a88a-e7fdf21fecbe', '9125711c-7714-4a10-87e2-30fad4b73184', 'ed6c473f-d517-4c57-8951-ffa06f315bad', '8ef6867f-14be-417b-8401-612e704716e6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:20:21 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD Nov 05 16:20:21 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:21 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:20:21 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:21 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1974812494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf5cc51-566b-4518-a388-36e35852968d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c127e0f7df4e7e93fc2a9cbd8a1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:17Z,use_quota=True,user_id='220515193efe474683b6e1d741de053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e481d611-4ec3-41d7-bb60-3a96ce5c8811),volume_type_id=e481d611-4ec3-41d7-bb60-3a96ce5c8811)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Creating volume 0bf5cc51-566b-4518-a388-36e35852968d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:20:21 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "cinder-779b6fb1-da37-4328-80c2-f5ee400dff6d-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:21 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d 1073741824 Nov 05 16:20:21 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:21 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-779b6fb1-da37-4328-80c2-f5ee400dff6d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.299s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:20:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Deleted volume successfully. Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c7559d5e-8e46-4ffe-bd79-6cd79096bcce tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-8771e638-ca96-45cd-a28d-e59e2f2446b6-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "cinder-quobyte-779b6fb1-da37-4328-80c2-f5ee400dff6d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-quobyte-779b6fb1-da37-4328-80c2-f5ee400dff6d" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a695dcb-6ef1-4c51-af9a-c1e839b4fbac]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:22 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d Nov 05 16:20:22 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:22 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d 1073741824" returned: 0 in 0.535s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:22 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d Nov 05 16:20:22 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:22 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d" returned: 0 in 0.443s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:22 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d Nov 05 16:20:22 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:22 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:22 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-779b6fb1-da37-4328-80c2-f5ee400dff6d" returned: 0 in 0.285s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Attempting download of 86c0acf1-4416-4696-9c8e-ecf0486ba73c ((None, [{'url': 'file:///opt/stack/data/glance/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'metadata': {}}])) to volume 0bf5cc51-566b-4518-a388-36e35852968d. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-quobyte-779b6fb1-da37-4328-80c2-f5ee400dff6d" released by "delete_volume" :: held 0.804s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b960257-7e5b-4342-afc6-5e25ac0a18b8]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86c0acf1-4416-4696-9c8e-ecf0486ba73c_0znj682i {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Created reservations ['3cc6ea2e-8c38-49c1-bcc0-bce166815aaa', 'd7341326-3611-42a8-b29b-1174cc5657ea', '73e922ac-7be7-44ec-aff8-e56cff96d876', 'ae58a603-a3a8-4e1c-b745-ee92100b05e8'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:22 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86c0acf1-4416-4696-9c8e-ecf0486ba73c_0znj682i Nov 05 16:20:22 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:22 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:20:22 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:23 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:23 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.296s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86c0acf1-4416-4696-9c8e-ecf0486ba73c_0znj682i" returned: 0 in 0.403s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86c0acf1-4416-4696-9c8e-ecf0486ba73c_0znj682i {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Deleted volume successfully. Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-43968e49-a190-4e26-975c-2ce760306a1c tempest-TestServerVolumeAttachmentScenario-1723448491 None] Lock "cinder-779b6fb1-da37-4328-80c2-f5ee400dff6d-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:23 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86c0acf1-4416-4696-9c8e-ecf0486ba73c_0znj682i Nov 05 16:20:23 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:23 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86c0acf1-4416-4696-9c8e-ecf0486ba73c_0znj682i" returned: 1 in 0.365s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86c0acf1-4416-4696-9c8e-ecf0486ba73c_0znj682i' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[995cb455-d4c9-4b93-a711-47bd30fc079f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:23 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD Nov 05 16:20:23 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:23 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] 86c0acf1-4416-4696-9c8e-ecf0486ba73c was qcow2, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:20:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:23 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d Nov 05 16:20:23 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:26 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d" returned: 0 in 2.080s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86c0acf1-4416-4696-9c8e-ecf0486ba73c_y5jpgo44devstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:20:26 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Converted 112.00 MB image at 53.81 MB/s Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:26 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d 1G Nov 05 16:20:26 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f4e4984d-414a-4167-a3ad-762bbb465c94 req-12d089fb-2781-4d1b-9fd3-4ce1d327b7ff tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f4e4984d-414a-4167-a3ad-762bbb465c94 req-12d089fb-2781-4d1b-9fd3-4ce1d327b7ff tempest-TestStampPattern-1800395907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f4e4984d-414a-4167-a3ad-762bbb465c94 req-12d089fb-2781-4d1b-9fd3-4ce1d327b7ff tempest-TestStampPattern-1800395907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-f4e4984d-414a-4167-a3ad-762bbb465c94 req-12d089fb-2781-4d1b-9fd3-4ce1d327b7ff tempest-TestStampPattern-1800395907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-90a70d13-620f-4511-b4cc-7098ab0b3e54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e882cd5-194d-4c70-80bd-26f93096256d', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:20:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-f4e4984d-414a-4167-a3ad-762bbb465c94 req-12d089fb-2781-4d1b-9fd3-4ce1d327b7ff tempest-TestStampPattern-1800395907 None] attachment_update completed successfully. Nov 05 16:20:26 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d 1G" returned: 0 in 0.378s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Downloaded image 86c0acf1-4416-4696-9c8e-ecf0486ba73c ((None, [{'url': 'file:///opt/stack/data/glance/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'metadata': {}}])) to volume 0bf5cc51-566b-4518-a388-36e35852968d successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Temporary image 86c0acf1-4416-4696-9c8e-ecf0486ba73c for user 220515193efe474683b6e1d741de053d is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Marking volume 0bf5cc51-566b-4518-a388-36e35852968d as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Copying metadata from image 86c0acf1-4416-4696-9c8e-ecf0486ba73c to 0bf5cc51-566b-4518-a388-36e35852968d. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Creating volume glance metadata for volume 0bf5cc51-566b-4518-a388-36e35852968d backed by image 86c0acf1-4416-4696-9c8e-ecf0486ba73c with: {'image_id': '86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'image_name': 'tempest-scenario-img--281327886', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b351080c-7525-40dc-8a7c-948004a9552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf5cc51-566b-4518-a388-36e35852968d', 'volume_size': 1, 'image_id': '86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--281327886', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b2c127e0f7df4e7e93fc2a9cbd8a1cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86c0acf1-4416-4696-9c8e-ecf0486ba73c', 'created_at': datetime.datetime(2026, 11, 5, 15, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 20, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86c0acf1-4416-4696-9c8e-ecf0486ba73c/file', 'properties': {}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c68b91f-e83e-46db-9966-51aa7e7d17b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:26 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Volume volume-0bf5cc51-566b-4518-a388-36e35852968d (0bf5cc51-566b-4518-a388-36e35852968d): created successfully Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c68b91f-e83e-46db-9966-51aa7e7d17b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Flow 'volume_create_manager' (fe02e44d-a223-4085-b711-143a5df8997c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-833c7a3f-af0b-41d0-bc08-d61345f642fb tempest-TestInstancesWithCinderVolumes-329544364 None] Created volume successfully. Nov 05 16:20:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-e645943b-1c5c-4137-b958-8671b598024c req-da55cc0f-7d88-432c-a4aa-30afdcbb4cae tempest-TestStampPattern-1800395907 None] Terminate volume connection completed successfully. Nov 05 16:20:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-e645943b-1c5c-4137-b958-8671b598024c req-da55cc0f-7d88-432c-a4aa-30afdcbb4cae tempest-TestStampPattern-1800395907 None] Deleting attachment 9e882cd5-194d-4c70-80bd-26f93096256d. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:20:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-1cede5d8-5727-47cb-9b4f-dc43939499ff req-bc42ee94-c13a-4071-b4b1-d92a838f9e61 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-1cede5d8-5727-47cb-9b4f-dc43939499ff req-bc42ee94-c13a-4071-b4b1-d92a838f9e61 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-1cede5d8-5727-47cb-9b4f-dc43939499ff req-bc42ee94-c13a-4071-b4b1-d92a838f9e61 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-1cede5d8-5727-47cb-9b4f-dc43939499ff req-bc42ee94-c13a-4071-b4b1-d92a838f9e61 tempest-TestInstancesWithCinderVolumes-329544364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-0bf5cc51-566b-4518-a388-36e35852968d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1dc7128-a1e1-46e6-aac8-3c7a0deada6b', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:20:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-1cede5d8-5727-47cb-9b4f-dc43939499ff req-bc42ee94-c13a-4071-b4b1-d92a838f9e61 tempest-TestInstancesWithCinderVolumes-329544364 None] attachment_update completed successfully. Nov 05 16:20:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-90a70d13-620f-4511-b4cc-7098ab0b3e54-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Lock "cinder-90a70d13-620f-4511-b4cc-7098ab0b3e54-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-quobyte-90a70d13-620f-4511-b4cc-7098ab0b3e54" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-90a70d13-620f-4511-b4cc-7098ab0b3e54" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:35 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[feabd7c7-5e4b-4f67-adf8-bfb10739f013]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:36 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 Nov 05 16:20:36 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:36 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54" returned: 0 in 0.621s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:36 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54 Nov 05 16:20:36 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:36 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90a70d13-620f-4511-b4cc-7098ab0b3e54" returned: 0 in 0.346s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-90a70d13-620f-4511-b4cc-7098ab0b3e54" released by "delete_volume" :: held 1.057s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:36 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Created reservations ['1885754a-a8bc-44c4-b2e2-0981a30cc999', 'b0b47ee8-dbca-4394-b1f0-602f1ad99dd4', '4ce5c2ce-a1ad-4b1d-8fde-c2b3dff771be', '18808766-5a4d-4f9c-ac6e-e900ebdd929b'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:37 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:20:37 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:37 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.293s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:20:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Deleted volume successfully. Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ac4a1347-8c7f-4cdc-905d-7fe2d3434458 tempest-TestStampPattern-1800395907 None] Lock "cinder-90a70d13-620f-4511-b4cc-7098ab0b3e54-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Flow 'volume_create_manager' (22fbd4b9-e2b1-4ac0-a870-1f3d527ddc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7932aa3b-e258-440d-827a-a61b741589d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7932aa3b-e258-440d-827a-a61b741589d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-75254138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad91308b-eee9-4859-b0d3-61e757cee2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48f7a0be906439390dfc2e7e86a52c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:38Z,use_quota=True,user_id='ce3fc89f954b4189a35825a32c315623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67dfbd5-5779-424c-9837-648b62eea8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67dfbd5-5779-424c-9837-648b62eea8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faafe04-87e1-4741-81b0-61d59345a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faafe04-87e1-4741-81b0-61d59345a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad91308b-eee9-4859-b0d3-61e757cee2c9', 'volume_name': 'volume-ad91308b-eee9-4859-b0d3-61e757cee2c9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316fb07b-044a-4e8a-9d54-b8721c3c0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316fb07b-044a-4e8a-9d54-b8721c3c0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd925d6-4531-4240-aca3-db296310b259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Volume ad91308b-eee9-4859-b0d3-61e757cee2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad91308b-eee9-4859-b0d3-61e757cee2c9', 'volume_size': 1} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-75254138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad91308b-eee9-4859-b0d3-61e757cee2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48f7a0be906439390dfc2e7e86a52c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:38Z,use_quota=True,user_id='ce3fc89f954b4189a35825a32c315623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Creating volume ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:20:38 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:38 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 1073741824 Nov 05 16:20:38 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-7fcc9b3b-58fb-448c-8b5c-e12344aa1908-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Lock "cinder-7fcc9b3b-58fb-448c-8b5c-e12344aa1908-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-quobyte-6883062c-5652-412a-9f2e-cea35902b3aa" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-6883062c-5652-412a-9f2e-cea35902b3aa" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-quobyte-7fcc9b3b-58fb-448c-8b5c-e12344aa1908" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-7fcc9b3b-58fb-448c-8b5c-e12344aa1908" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Deleting offline snapshot 7fcc9b3b-58fb-448c-8b5c-e12344aa1908 of volume 6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] snapshot_file for this snap is: volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b3085-0c1f-428e-9c71-728ecde02dc2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:38 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 Nov 05 16:20:38 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:38 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 1073741824" returned: 0 in 0.736s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:39 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 Nov 05 16:20:39 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:39 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908" returned: 0 in 0.664s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6883062c-5652-412a-9f2e-cea35902b3aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2511397-187e-4334-a7da-c25141eaaf88]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:39 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9" returned: 0 in 0.469s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd925d6-4531-4240-aca3-db296310b259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad91308b-eee9-4859-b0d3-61e757cee2c9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc476bb-b8c3-418f-875f-97aa95b17add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Volume volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 (ad91308b-eee9-4859-b0d3-61e757cee2c9): created successfully Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc476bb-b8c3-418f-875f-97aa95b17add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Flow 'volume_create_manager' (22fbd4b9-e2b1-4ac0-a870-1f3d527ddc09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-928fc22b-bfb4-40f1-9b1e-06e5289e1fe8 tempest-VolumeDependencyTests-126327578 None] Created volume successfully. Nov 05 16:20:39 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa Nov 05 16:20:39 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:39 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa" returned: 0 in 0.677s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:40 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 Nov 05 16:20:40 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Creating offline snapshot 6c355a87-b258-4084-a8cd-1486ffed7c4b of volume ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[550e6a86-5f56-4d75-ba9e-d83f8e9c5fee]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:40 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 Nov 05 16:20:40 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:40 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908" returned: 0 in 0.677s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:40 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908 Nov 05 16:20:40 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:40 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa.7fcc9b3b-58fb-448c-8b5c-e12344aa1908" returned: 0 in 0.320s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-7fcc9b3b-58fb-448c-8b5c-e12344aa1908" released by "_delete_snapshot" :: held 2.499s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-6883062c-5652-412a-9f2e-cea35902b3aa" released by "delete_snapshot" :: held 2.556s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:41 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9" returned: 0 in 0.647s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:41 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b 1G Nov 05 16:20:41 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Created reservations ['3c7148bb-7f71-4f4b-a7d1-15fb66ac1cc6', '43efbe9b-47f2-41ad-83df-c402398ec4ad', '29a8e491-c9a5-4e14-92b4-ab37a9dab357', '5040af0d-30e9-4608-ac5c-983d5f207c62'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:20:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Delete snapshot completed successfully. Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-64f3cdb5-13f3-4a98-bcc0-efc3478e423c tempest-TestStampPattern-1800395907 None] Lock "cinder-7fcc9b3b-58fb-448c-8b5c-e12344aa1908-delete_snapshot" released by "delete_snapshot" :: held 2.832s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:41 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b 1G" returned: 0 in 0.801s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:41 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b Nov 05 16:20:41 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:42 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:42 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b is being set with open permissions: ugo+rw Nov 05 16:20:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:42 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b Nov 05 16:20:42 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:42 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b" returned: 0 in 0.329s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:42 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.info Nov 05 16:20:42 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:43 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.info" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:43 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.info is being set with open permissions: ugo+rw Nov 05 16:20:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:43 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.info Nov 05 16:20:43 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:43 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.info" returned: 0 in 0.530s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.231s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-168b4d3c-067e-4490-9a3a-442bc47575a5 tempest-VolumeDependencyTests-126327578 None] Create snapshot completed successfully Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Flow 'volume_create_manager' (f5bff871-1530-4523-9e09-a53c3332faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b88251-959c-4c98-b429-6c17df90664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b88251-959c-4c98-b429-6c17df90664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2141636416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5ef525-8a2d-4ef9-b798-66827b311328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48f7a0be906439390dfc2e7e86a52c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6c355a87-b258-4084-a8cd-1486ffed7c4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:20:46Z,use_quota=True,user_id='ce3fc89f954b4189a35825a32c315623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b7b760-00ae-4afd-9bff-603be06350cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b7b760-00ae-4afd-9bff-603be06350cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88f5830-4fbe-4fdd-b6ce-61a1b5b31fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88f5830-4fbe-4fdd-b6ce-61a1b5b31fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef5ef525-8a2d-4ef9-b798-66827b311328', 'volume_name': 'volume-ef5ef525-8a2d-4ef9-b798-66827b311328', 'volume_size': 1, 'snapshot_id': '6c355a87-b258-4084-a8cd-1486ffed7c4b'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a307c40b-5bc0-4349-adef-37a3acbe57a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a307c40b-5bc0-4349-adef-37a3acbe57a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb193b4f-e806-4386-82a4-128bd9483824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:45 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Volume ef5ef525-8a2d-4ef9-b798-66827b311328: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef5ef525-8a2d-4ef9-b798-66827b311328', 'volume_size': 1, 'snapshot_id': '6c355a87-b258-4084-a8cd-1486ffed7c4b'} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-quobyte-6c355a87-b258-4084-a8cd-1486ffed7c4b-ef5ef525-8a2d-4ef9-b798-66827b311328" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-6c355a87-b258-4084-a8cd-1486ffed7c4b-ef5ef525-8a2d-4ef9-b798-66827b311328" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Creating volume ef5ef525-8a2d-4ef9-b798-66827b311328 from snapshot 6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-quobyte-ef5ef525-8a2d-4ef9-b798-66827b311328" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ef5ef525-8a2d-4ef9-b798-66827b311328" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] snapshot: 6c355a87-b258-4084-a8cd-1486ffed7c4b, volume: ef5ef525-8a2d-4ef9-b798-66827b311328, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6964bb-11ba-45d3-b4f0-22f10f2239e2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:46 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b Nov 05 16:20:46 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:46 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b" returned: 0 in 0.457s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad91308b-eee9-4859-b0d3-61e757cee2c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f21e94-17ed-4e2b-b854-7b8c9bc40d31]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:46 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 Nov 05 16:20:46 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-6883062c-5652-412a-9f2e-cea35902b3aa-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Lock "cinder-6883062c-5652-412a-9f2e-cea35902b3aa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Acquiring lock "cinder-quobyte-6883062c-5652-412a-9f2e-cea35902b3aa" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-6883062c-5652-412a-9f2e-cea35902b3aa" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[328c583e-2c34-4e7f-b796-0b374dce5c99]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:46 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa Nov 05 16:20:46 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:46 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9" returned: 0 in 0.612s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:47 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 Nov 05 16:20:47 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:47 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa" returned: 0 in 0.422s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:47 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa Nov 05 16:20:47 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:47 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6883062c-5652-412a-9f2e-cea35902b3aa" returned: 0 in 0.366s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Lock "cinder-quobyte-6883062c-5652-412a-9f2e-cea35902b3aa" released by "delete_volume" :: held 0.889s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Created reservations ['944864d7-6a39-4986-9ad1-db0a4a86e980', '64f64245-04b1-4b55-86e2-a5773f951923', '5a86629d-add9-4d99-bb0a-7abab9a36a91', 'ce0b07ca-64b1-4c21-bdfe-89ac961faef5'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:48 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:20:48 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:48 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.678s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:48 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:20:48 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Deleted volume successfully. Nov 05 16:20:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e8aae929-b195-42a0-bb7b-8e4c03a7121d tempest-TestStampPattern-1800395907 None] Lock "cinder-6883062c-5652-412a-9f2e-cea35902b3aa-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:50 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:20:50 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:50 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.727s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:20:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:20:56 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328" returned: 0 in 9.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9, size 1024.00 MB, duration 9.39 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:20:56 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Converted 1024.00 MB image at 109.01 MB/s Nov 05 16:20:56 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 is being set with open permissions: ugo+rw Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:56 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 Nov 05 16:20:56 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:56 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ef5ef525-8a2d-4ef9-b798-66827b311328" released by "_copy_volume_from_snapshot" :: held 10.866s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-6c355a87-b258-4084-a8cd-1486ffed7c4b-ef5ef525-8a2d-4ef9-b798-66827b311328" released by "_create_volume_from_snapshot" :: held 10.957s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.981s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb193b4f-e806-4386-82a4-128bd9483824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5ef525-8a2d-4ef9-b798-66827b311328', 'volume_size': 1, 'snapshot_id': '6c355a87-b258-4084-a8cd-1486ffed7c4b'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85420107-c62b-46ab-b92b-87824b1dbc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:20:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Volume volume-ef5ef525-8a2d-4ef9-b798-66827b311328 (ef5ef525-8a2d-4ef9-b798-66827b311328): created successfully Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85420107-c62b-46ab-b92b-87824b1dbc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:20:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Flow 'volume_create_manager' (f5bff871-1530-4523-9e09-a53c3332faff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:20:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3cd3fd0d-44a3-44d0-8e9a-a0189388713e tempest-VolumeDependencyTests-126327578 None] Created volume successfully. Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-6c355a87-b258-4084-a8cd-1486ffed7c4b-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-6c355a87-b258-4084-a8cd-1486ffed7c4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-quobyte-ad91308b-eee9-4859-b0d3-61e757cee2c9" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ad91308b-eee9-4859-b0d3-61e757cee2c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-quobyte-6c355a87-b258-4084-a8cd-1486ffed7c4b" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-6c355a87-b258-4084-a8cd-1486ffed7c4b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Deleting offline snapshot 6c355a87-b258-4084-a8cd-1486ffed7c4b of volume ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] snapshot_file for this snap is: volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb38e176-2187-477f-b62f-afc9f3f8393f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:58 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b Nov 05 16:20:58 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:58 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b" returned: 0 in 0.384s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad91308b-eee9-4859-b0d3-61e757cee2c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:20:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec047a78-b233-48d7-b5d3-444ec305102b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:20:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:58 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 Nov 05 16:20:58 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:58 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9" returned: 0 in 0.588s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:58 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b Nov 05 16:20:58 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:59 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:20:59 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b Nov 05 16:20:59 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:20:59 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Nov 05 16:20:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9.6c355a87-b258-4084-a8cd-1486ffed7c4b" returned: 0 in 0.274s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:20:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-6c355a87-b258-4084-a8cd-1486ffed7c4b" released by "_delete_snapshot" :: held 1.769s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ad91308b-eee9-4859-b0d3-61e757cee2c9" released by "delete_snapshot" :: held 1.800s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:20:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Created reservations ['3958eb8b-0c56-4c46-8cb8-aa3518be0c94', 'fa19055a-9151-4e48-b3e1-01fd2e044db7', '801f2d7e-fe92-433e-b4e8-ecbd13ba36fe', '060f4dbb-4c8b-41a3-9c4f-c0168bf39793'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:20:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Delete snapshot completed successfully. Nov 05 16:20:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6ebcffb5-a10f-4922-8dfe-d22f42a197b1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-6c355a87-b258-4084-a8cd-1486ffed7c4b-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-ad91308b-eee9-4859-b0d3-61e757cee2c9-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Lock "cinder-ad91308b-eee9-4859-b0d3-61e757cee2c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-quobyte-ad91308b-eee9-4859-b0d3-61e757cee2c9" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ad91308b-eee9-4859-b0d3-61e757cee2c9" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca02b6-45dd-484e-8225-8c259d8ecddc]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:00 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 Nov 05 16:21:00 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:00 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:00 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9 Nov 05 16:21:00 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:00 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ad91308b-eee9-4859-b0d3-61e757cee2c9" returned: 0 in 0.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ad91308b-eee9-4859-b0d3-61e757cee2c9" released by "delete_volume" :: held 0.686s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Created reservations ['5743608a-e8de-4934-a517-49a1a0891b2d', 'd9d599b3-1d09-4939-aa59-951b944d8356', '354b3702-b51b-41fe-9e0c-e14ce0d1358a', 'c123a48d-58d8-427f-afc2-8f2baeb6105a'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:00 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:00 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-ef5ef525-8a2d-4ef9-b798-66827b311328-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:01 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.275s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-ef5ef525-8a2d-4ef9-b798-66827b311328-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Deleted volume successfully. Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0511cdf9-219f-410e-9103-230af3987fba tempest-VolumeDependencyTests-126327578 None] Lock "cinder-ad91308b-eee9-4859-b0d3-61e757cee2c9-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "cinder-quobyte-ef5ef525-8a2d-4ef9-b798-66827b311328" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ef5ef525-8a2d-4ef9-b798-66827b311328" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c386c2-b884-40e6-9d2f-1a508e02173c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:01 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 Nov 05 16:21:01 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:01 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328" returned: 0 in 0.381s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:01 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328 Nov 05 16:21:01 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:02 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ef5ef525-8a2d-4ef9-b798-66827b311328" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-quobyte-ef5ef525-8a2d-4ef9-b798-66827b311328" released by "delete_volume" :: held 0.732s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Created reservations ['121a9a3d-7bec-4d6d-b1a8-35eb60870006', 'e6f31588-e515-4bbe-89eb-634b07f05ec8', '5dab2081-6fdc-474d-b188-c1aa717a3db3', '8a2a747c-4f9c-4df7-8c5d-ae28947d60c9'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:02 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:02 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:02 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Deleted volume successfully. Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=93,cinder:UPDATE=85,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:21:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d34a1103-56a8-40d0-8d07-c34e2202c4e1 tempest-VolumeDependencyTests-126327578 None] Lock "cinder-ef5ef525-8a2d-4ef9-b798-66827b311328-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=90,cinder:UPDATE=82,cinder:DELETE=6,cinder:INSERT=23 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Flow 'volume_create_manager' (04d03dca-4af4-4603-985b-b208926095b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb815ea2-a7c7-46d7-9ffe-205e87d58dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb815ea2-a7c7-46d7-9ffe-205e87d58dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c5817a-f0e2-4c61-8df6-84105f37d10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb5fe3922e4828a1be5a9db238cd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:06Z,use_quota=True,user_id='bb98a3b5d5d2406482f3258077c2379d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cecf06e-8dcb-44b8-b330-572d42e9f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cecf06e-8dcb-44b8-b330-572d42e9f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb068a3-45b7-49fa-bc7d-6faafa0a7f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb068a3-45b7-49fa-bc7d-6faafa0a7f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c5817a-f0e2-4c61-8df6-84105f37d10f', 'volume_name': 'volume-28c5817a-f0e2-4c61-8df6-84105f37d10f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab81ee1-4f1c-4a4b-889b-0898d29da320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab81ee1-4f1c-4a4b-889b-0898d29da320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203f794e-3641-4c19-af4f-a132ff9bc47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Volume 28c5817a-f0e2-4c61-8df6-84105f37d10f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c5817a-f0e2-4c61-8df6-84105f37d10f', 'volume_size': 1} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c5817a-f0e2-4c61-8df6-84105f37d10f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb5fe3922e4828a1be5a9db238cd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:06Z,use_quota=True,user_id='bb98a3b5d5d2406482f3258077c2379d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Creating volume 28c5817a-f0e2-4c61-8df6-84105f37d10f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:06 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:06 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f 1073741824 Nov 05 16:21:06 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (3dc9da5b-65f6-48e6-b536-26fcaf889b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4c8687-0b94-45ce-97c2-3a1e24f43230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4c8687-0b94-45ce-97c2-3a1e24f43230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-353361554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:06Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e22feed-2866-4513-ab4e-fce05322e780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e22feed-2866-4513-ab4e-fce05322e780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c706261f-d82e-46a9-be3c-37336532a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c706261f-d82e-46a9-be3c-37336532a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac', 'volume_name': 'volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4209661c-4e27-4b44-bd57-bb9a6fffa5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4209661c-4e27-4b44-bd57-bb9a6fffa5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385fb1bd-ffeb-4da5-8127-a0d97632b41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac', 'volume_size': 1} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:06 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f 1073741824" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:06 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f Nov 05 16:21:06 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:06 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f" returned: 0 in 0.270s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-353361554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:06Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Creating volume eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:06 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203f794e-3641-4c19-af4f-a132ff9bc47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c5817a-f0e2-4c61-8df6-84105f37d10f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac 1073741824 Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8561a1a7-3ff7-47c8-bae3-d1900c95b172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:06 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:06 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Volume volume-28c5817a-f0e2-4c61-8df6-84105f37d10f (28c5817a-f0e2-4c61-8df6-84105f37d10f): created successfully Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8561a1a7-3ff7-47c8-bae3-d1900c95b172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:06 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Flow 'volume_create_manager' (04d03dca-4af4-4603-985b-b208926095b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:06 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f2d83876-a4b3-47b5-b7ad-cdf219bf4d0c tempest-CinderUnicodeTest-1319288859 None] Created volume successfully. Nov 05 16:21:07 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac 1073741824" returned: 0 in 0.411s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:07 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac Nov 05 16:21:07 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:07 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385fb1bd-ffeb-4da5-8127-a0d97632b41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58d5b02-f57e-4015-878f-548514bd2818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:07 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac (eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac): created successfully Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58d5b02-f57e-4015-878f-548514bd2818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:07 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (3dc9da5b-65f6-48e6-b536-26fcaf889b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fc4334b3-c1e7-4ca5-a7ad-e07aa6cebb7a tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created volume successfully. Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Creating offline snapshot 4a030d42-4b70-409d-a641-ffc7ec8fb7e6 of volume eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb25d751-86a3-4d14-8022-04fce4f54d7e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:08 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac Nov 05 16:21:08 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Flow 'volume_create_manager' (780d83c6-4fb2-4c97-8a41-b087457af016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9f8b90-877c-4b1a-ade7-9862af03d931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9f8b90-877c-4b1a-ade7-9862af03d931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-805579607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa9525e-eef1-4aae-82e4-1a0f3e8238d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb5fe3922e4828a1be5a9db238cd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:09Z,use_quota=True,user_id='bb98a3b5d5d2406482f3258077c2379d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d4aca5-aaa0-4c5b-b600-0a91c3dfcc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d4aca5-aaa0-4c5b-b600-0a91c3dfcc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03abe60e-15a8-497a-9759-67616fe57f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03abe60e-15a8-497a-9759-67616fe57f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa9525e-eef1-4aae-82e4-1a0f3e8238d5', 'volume_name': 'volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:08 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46110acd-9193-4eb3-9504-340022a23960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46110acd-9193-4eb3-9504-340022a23960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b1ae67-7a88-4e38-98e8-8d675bf15299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:08 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Volume 9aa9525e-eef1-4aae-82e4-1a0f3e8238d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5', 'volume_size': 1} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" returned: 0 in 0.480s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:08 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 1G Nov 05 16:21:08 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-8d7ff0d5-af5f-4f70-bc99-1417d1fd65b2 req-f942582d-68cb-4713-b092-9f2278d4fcde tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:09 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 1G" returned: 0 in 0.408s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:09 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 Nov 05 16:21:09 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:09 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:09 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 is being set with open permissions: ugo+rw Nov 05 16:21:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:09 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 Nov 05 16:21:09 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:09 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6" returned: 0 in 0.269s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:09 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.info Nov 05 16:21:09 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:10 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.info" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:10 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.info is being set with open permissions: ugo+rw Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:10 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.info Nov 05 16:21:10 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:10 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.info" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-805579607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa9525e-eef1-4aae-82e4-1a0f3e8238d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb5fe3922e4828a1be5a9db238cd52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:09Z,use_quota=True,user_id='bb98a3b5d5d2406482f3258077c2379d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Creating volume 9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:10 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:10 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 1073741824 Nov 05 16:21:10 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:10 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-34e36650-634a-41b4-9fbf-5e12c14b64f8 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Create snapshot completed successfully Nov 05 16:21:10 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 1073741824" returned: 0 in 0.464s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:10 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 Nov 05 16:21:10 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:11 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-8d7ff0d5-af5f-4f70-bc99-1417d1fd65b2 req-f942582d-68cb-4713-b092-9f2278d4fcde tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.206s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b1ae67-7a88-4e38-98e8-8d675bf15299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee10356-9177-4751-843f-b7d694833684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-8d7ff0d5-af5f-4f70-bc99-1417d1fd65b2 req-f942582d-68cb-4713-b092-9f2278d4fcde tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:11 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Volume volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 (9aa9525e-eef1-4aae-82e4-1a0f3e8238d5): created successfully Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee10356-9177-4751-843f-b7d694833684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Flow 'volume_create_manager' (780d83c6-4fb2-4c97-8a41-b087457af016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b64c39ca-a5e5-4e68-b475-600bfde2bd30 tempest-CinderUnicodeTest-1319288859 None] Created volume successfully. Nov 05 16:21:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-8d7ff0d5-af5f-4f70-bc99-1417d1fd65b2 req-f942582d-68cb-4713-b092-9f2278d4fcde tempest-TestInstancesWithCinderVolumes-329544364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-c60346b7-670e-4b8f-8318-00c1562df1d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '750fcdb9-a865-455f-9ad8-aedf7a16ddcd', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:21:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-8d7ff0d5-af5f-4f70-bc99-1417d1fd65b2 req-f942582d-68cb-4713-b092-9f2278d4fcde tempest-TestInstancesWithCinderVolumes-329544364 None] attachment_update completed successfully. Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (bfebd698-6cef-4c3f-baa0-5118f54a1439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8fcc70-bf4d-4050-995e-c13065324cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8fcc70-bf4d-4050-995e-c13065324cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430064243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f471554-5ce8-4705-af16-e63988104079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:12Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4382a5-f4a4-4917-9356-84868a4251ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4382a5-f4a4-4917-9356-84868a4251ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6557a7f0-a7ff-466e-9655-3bf29514934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6557a7f0-a7ff-466e-9655-3bf29514934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f471554-5ce8-4705-af16-e63988104079', 'volume_name': 'volume-3f471554-5ce8-4705-af16-e63988104079', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4225d53b-d28a-495b-9d0f-5d1bfeedc27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4225d53b-d28a-495b-9d0f-5d1bfeedc27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3571f86f-d331-4181-87e5-b36415d4f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume 3f471554-5ce8-4705-af16-e63988104079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f471554-5ce8-4705-af16-e63988104079', 'volume_size': 1} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430064243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f471554-5ce8-4705-af16-e63988104079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:12Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Creating volume 3f471554-5ce8-4705-af16-e63988104079 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:12 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:12 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 1073741824 Nov 05 16:21:12 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (300364aa-32e5-44af-be65-99e6902e181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0d364d-bd5e-4c0f-b27c-c2ae8f4e5d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0d364d-bd5e-4c0f-b27c-c2ae8f4e5d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-369501869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea9443b-5753-4dc0-b830-a633eabda59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:12Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac083b98-f71b-4cf3-82ad-03619612558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac083b98-f71b-4cf3-82ad-03619612558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a081c8c-743c-4284-a4d7-bd9a1e98e27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a081c8c-743c-4284-a4d7-bd9a1e98e27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea9443b-5753-4dc0-b830-a633eabda59f', 'volume_name': 'volume-bea9443b-5753-4dc0-b830-a633eabda59f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f113b8-97bb-48d4-83e1-4b3463adc0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f113b8-97bb-48d4-83e1-4b3463adc0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b17906-a24a-4d55-94a7-12012c6be9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:12 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume bea9443b-5753-4dc0-b830-a633eabda59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea9443b-5753-4dc0-b830-a633eabda59f', 'volume_size': 1} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:12 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 1073741824" returned: 0 in 0.601s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:12 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 Nov 05 16:21:12 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (8ecc92bd-0ff9-4d43-b578-c18e76b9ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affa853c-4f04-47a9-92d9-25e4cea19b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affa853c-4f04-47a9-92d9-25e4cea19b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410949592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fee7ce-2659-45d2-9e86-a34f16adf3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:13Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80769315-c8d5-48c8-a1e0-b97b73246549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80769315-c8d5-48c8-a1e0-b97b73246549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01d9087-925f-4631-9530-a0ead175eb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01d9087-925f-4631-9530-a0ead175eb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61fee7ce-2659-45d2-9e86-a34f16adf3b9', 'volume_name': 'volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed988fd-fd90-4e67-8c89-163d23326cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed988fd-fd90-4e67-8c89-163d23326cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0da6436-27b7-4b63-bb67-f774ddcedc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume 61fee7ce-2659-45d2-9e86-a34f16adf3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9', 'volume_size': 1} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:13 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.904s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3571f86f-d331-4181-87e5-b36415d4f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f471554-5ce8-4705-af16-e63988104079', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865ca3b6-7133-42e4-8c21-7c9a42d6542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Creating offline snapshot b983f792-15b9-4026-9df6-14ca6457a879 of volume 9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:21:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume volume-3f471554-5ce8-4705-af16-e63988104079 (3f471554-5ce8-4705-af16-e63988104079): created successfully Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865ca3b6-7133-42e4-8c21-7c9a42d6542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (bfebd698-6cef-4c3f-baa0-5118f54a1439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adde2cd-436c-4399-8898-eca914dc0a8c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f8be19d8-500b-428e-bda4-c9967c367009 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created volume successfully. Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-01401796-8ac3-4360-b751-60284469cbd4 req-29a48d47-ba03-4042-8d4a-ec8f18579b2d tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (139ff0e4-3baf-4815-b226-c617ce293463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4955498-1b20-4f4d-a4df-88f3d7ae3bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 Nov 05 16:21:13 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4955498-1b20-4f4d-a4df-88f3d7ae3bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943841256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:13Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcbddc1-f492-4893-a1a3-b2efcecc3227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcbddc1-f492-4893-a1a3-b2efcecc3227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13c600a-a1a9-4928-b777-fa6400dd9738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13c600a-a1a9-4928-b777-fa6400dd9738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661', 'volume_name': 'volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8de9d5-f3c2-4496-8b3c-8584e5163055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8de9d5-f3c2-4496-8b3c-8584e5163055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eaee54e-c876-4584-a21d-74096e4ebed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661', 'volume_size': 1} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:13 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:13 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 1G Nov 05 16:21:13 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (e4678960-562c-421f-8f40-7dff9f1d3a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c08483c-43e0-440d-96a2-a43d03d0f41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c08483c-43e0-440d-96a2-a43d03d0f41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-366054174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac414be0-493f-456c-9bce-da8c6e206046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:14Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a128b765-d333-40b0-b0ff-92d302507ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a128b765-d333-40b0-b0ff-92d302507ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefa581d-6c7d-41c5-8b38-dd03c5efafaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefa581d-6c7d-41c5-8b38-dd03c5efafaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac414be0-493f-456c-9bce-da8c6e206046', 'volume_name': 'volume-ac414be0-493f-456c-9bce-da8c6e206046', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee57e4-8bce-4b0e-99c4-aea4ce5c53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee57e4-8bce-4b0e-99c4-aea4ce5c53be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96011f4d-9883-437a-a6b6-b94df823582d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume ac414be0-493f-456c-9bce-da8c6e206046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac414be0-493f-456c-9bce-da8c6e206046', 'volume_size': 1} Nov 05 16:21:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:14 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 1G" returned: 0 in 0.434s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:14 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 Nov 05 16:21:14 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:14 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879" returned: 0 in 0.287s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:14 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 is being set with open permissions: ugo+rw Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:14 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 Nov 05 16:21:14 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:14 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879" returned: 0 in 0.254s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:14 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.info Nov 05 16:21:14 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:14 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.info" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:14 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.info is being set with open permissions: ugo+rw Nov 05 16:21:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:14 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.info Nov 05 16:21:14 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:15 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.info" returned: 0 in 0.234s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.605s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-369501869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea9443b-5753-4dc0-b830-a633eabda59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:12Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Creating volume bea9443b-5753-4dc0-b830-a633eabda59f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:15 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:15 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f 1073741824 Nov 05 16:21:15 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c16d0330-ae13-4800-b30a-6259acf01156 tempest-CinderUnicodeTest-1319288859 None] Create snapshot completed successfully Nov 05 16:21:15 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f 1073741824" returned: 0 in 0.408s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:15 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f Nov 05 16:21:15 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "cinder-b983f792-15b9-4026-9df6-14ca6457a879-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-b983f792-15b9-4026-9df6-14ca6457a879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "cinder-quobyte-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "cinder-quobyte-b983f792-15b9-4026-9df6-14ca6457a879" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-b983f792-15b9-4026-9df6-14ca6457a879" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Deleting offline snapshot b983f792-15b9-4026-9df6-14ca6457a879 of volume 9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] snapshot_file for this snap is: volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e604551-0f87-4ddf-9294-4746a9de207b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:15 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.821s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410949592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fee7ce-2659-45d2-9e86-a34f16adf3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:13Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Creating volume 61fee7ce-2659-45d2-9e86-a34f16adf3b9 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:15 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b17906-a24a-4d55-94a7-12012c6be9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea9443b-5753-4dc0-b830-a633eabda59f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:15 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 1073741824 Nov 05 16:21:15 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a3b651-f610-4c09-b64a-ca4d3fcf5d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume volume-bea9443b-5753-4dc0-b830-a633eabda59f (bea9443b-5753-4dc0-b830-a633eabda59f): created successfully Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a3b651-f610-4c09-b64a-ca4d3fcf5d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (300364aa-32e5-44af-be65-99e6902e181b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:15 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 Nov 05 16:21:15 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-11921f06-5ce0-4630-ab3a-8b63cb883e4e tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created volume successfully. Nov 05 16:21:16 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879" returned: 0 in 0.415s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b43925c-2776-42d8-98c8-1bd76207cea0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:16 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 1073741824" returned: 0 in 0.450s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:16 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 Nov 05 16:21:16 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:16 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 Nov 05 16:21:16 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:16 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9" returned: 0 in 0.254s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-01401796-8ac3-4360-b751-60284469cbd4 req-29a48d47-ba03-4042-8d4a-ec8f18579b2d tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.314s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-01401796-8ac3-4360-b751-60284469cbd4 req-29a48d47-ba03-4042-8d4a-ec8f18579b2d tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:16 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.206s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943841256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:13Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Creating volume a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:16 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0da6436-27b7-4b63-bb67-f774ddcedc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7feada4-12e2-4bd9-9431-4d9e7eb0126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" returned: 0 in 0.418s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:16 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 1073741824 Nov 05 16:21:16 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:16 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 Nov 05 16:21:16 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 (61fee7ce-2659-45d2-9e86-a34f16adf3b9): created successfully Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7feada4-12e2-4bd9-9431-4d9e7eb0126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (8ecc92bd-0ff9-4d43-b578-c18e76b9ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-01401796-8ac3-4360-b751-60284469cbd4 req-29a48d47-ba03-4042-8d4a-ec8f18579b2d tempest-TestInstancesWithCinderVolumes-329544364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70b2b74a-96ba-4b24-82d7-718d8267f711', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:21:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0f070680-d620-4880-a25d-ea369ca4e5e5 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created volume successfully. Nov 05 16:21:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-01401796-8ac3-4360-b751-60284469cbd4 req-29a48d47-ba03-4042-8d4a-ec8f18579b2d tempest-TestInstancesWithCinderVolumes-329544364 None] attachment_update completed successfully. Nov 05 16:21:17 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879" returned: 0 in 0.464s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:17 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879 Nov 05 16:21:17 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:17 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 1073741824" returned: 0 in 0.681s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:17 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 Nov 05 16:21:17 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:17 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5.b983f792-15b9-4026-9df6-14ca6457a879" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-b983f792-15b9-4026-9df6-14ca6457a879" released by "_delete_snapshot" :: held 1.731s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" released by "delete_snapshot" :: held 1.758s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Created reservations ['68ce6b63-be6e-494d-ba5b-31d7209b1c23', '9089071d-2f13-4639-9921-f5896545c87f', 'bb7e4a2e-5458-434a-ae47-4b818880b879', '9205a9f6-4d4b-4743-852f-8748870d6911'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Delete snapshot completed successfully. Nov 05 16:21:17 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661" returned: 0 in 0.286s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ea117858-ec10-4d2f-873b-c01cfd7c9045 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-b983f792-15b9-4026-9df6-14ca6457a879-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-366054174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac414be0-493f-456c-9bce-da8c6e206046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047d2667efe349c8930c0f1449c6ed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:14Z,use_quota=True,user_id='baf64508f5fd4e64924e77dc28e65a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Creating volume ac414be0-493f-456c-9bce-da8c6e206046 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:17 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eaee54e-c876-4584-a21d-74096e4ebed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:17 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 1073741824 Nov 05 16:21:17 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6c18a3-1fd2-45ed-be94-aa9be068f742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 (a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661): created successfully Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6c18a3-1fd2-45ed-be94-aa9be068f742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (139ff0e4-3baf-4815-b226-c617ce293463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bf7ea498-6779-4b97-9ef2-3a0cc634cfd6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created volume successfully. Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "cinder-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "cinder-quobyte-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[806c1f9d-1709-40e9-b117-ab046388db86]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:18 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 Nov 05 16:21:18 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:18 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 1073741824" returned: 0 in 0.518s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:18 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 Nov 05 16:21:18 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:18 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" returned: 0 in 0.411s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:18 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046" returned: 0 in 0.257s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:18 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5 Nov 05 16:21:18 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96011f4d-9883-437a-a6b6-b94df823582d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac414be0-493f-456c-9bce-da8c6e206046', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1cb001-e4da-41d1-8642-e6dffa1db500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Volume volume-ac414be0-493f-456c-9bce-da8c6e206046 (ac414be0-493f-456c-9bce-da8c6e206046): created successfully Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1cb001-e4da-41d1-8642-e6dffa1db500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Flow 'volume_create_manager' (e4678960-562c-421f-8f40-7dff9f1d3a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-13f8d3e1-06e7-47d1-b04a-29a8c681f6ff tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created volume successfully. Nov 05 16:21:18 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" returned: 0 in 0.249s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5" released by "delete_volume" :: held 0.728s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Created reservations ['21b0f825-cdd5-4904-a142-fe75784c5a88', '262fd4eb-1971-4b62-a173-571ad88af6ac', '6f592957-9c72-47f2-9a5d-487e97da4b23', '626540bd-0f68-4657-a721-8bc0cb137fac'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:18 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:18 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "cinder-28c5817a-f0e2-4c61-8df6-84105f37d10f-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:19 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-28c5817a-f0e2-4c61-8df6-84105f37d10f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Deleted volume successfully. Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "cinder-quobyte-28c5817a-f0e2-4c61-8df6-84105f37d10f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f8f94fba-b47e-4171-a090-dbf11c7c10dc tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-9aa9525e-eef1-4aae-82e4-1a0f3e8238d5-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-28c5817a-f0e2-4c61-8df6-84105f37d10f" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb09518-537a-4441-9cb2-c3f07c808da2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-ac414be0-493f-456c-9bce-da8c6e206046-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-ac414be0-493f-456c-9bce-da8c6e206046-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:19 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f Nov 05 16:21:19 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-ac414be0-493f-456c-9bce-da8c6e206046" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-ac414be0-493f-456c-9bce-da8c6e206046" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd259bb-b5af-405d-b477-f52c93b67c6d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:19 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 Nov 05 16:21:19 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:19 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:19 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f Nov 05 16:21:19 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:19 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046" returned: 0 in 0.419s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:19 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046 Nov 05 16:21:19 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:19 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-28c5817a-f0e2-4c61-8df6-84105f37d10f" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-quobyte-28c5817a-f0e2-4c61-8df6-84105f37d10f" released by "delete_volume" :: held 0.749s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Created reservations ['6e67bc5c-0399-40a9-a46b-bf0445514987', '83bd1c24-46a6-494f-bd1b-d9aa1091e0f9', '550caf0d-dc06-41c5-861a-60e9726de304', 'f969891d-0614-4c20-90bc-77a8b0b77858'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:20 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:20 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:20 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ac414be0-493f-456c-9bce-da8c6e206046" returned: 0 in 0.286s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-ac414be0-493f-456c-9bce-da8c6e206046" released by "delete_volume" :: held 0.759s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created reservations ['8d645343-c112-48ec-ba60-acb0d3af0d1f', '28a41438-965b-47dd-9a69-43b65f0cbbb1', '85ea6e8e-d418-45b1-9b11-75dd366955f3', 'fa78f1f9-ca35-4752-b35e-47debaaff7bb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:20 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:20 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:20 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.339s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:20 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Deleted volume successfully. Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ddb49a27-9afe-4f00-9cba-a29a227325f3 tempest-CinderUnicodeTest-1319288859 None] Lock "cinder-28c5817a-f0e2-4c61-8df6-84105f37d10f-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:20 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea78297-f931-46c9-8022-782330adafe2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.398s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:20 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Deleted volume successfully. Nov 05 16:21:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4db2e0db-a520-41f7-a819-d942756399e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-ac414be0-493f-456c-9bce-da8c6e206046-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:20 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 Nov 05 16:21:20 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:21 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661" returned: 0 in 0.443s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:21 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661 Nov 05 16:21:21 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:21 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661" returned: 0 in 0.304s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661" released by "delete_volume" :: held 0.806s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created reservations ['6016df81-7f11-499c-9b9b-7f364d68fa38', 'f481db73-2f0a-4892-8f5a-b5a2a8c9b06b', '7842d5d1-1c88-43c8-aa18-104c23f287c0', '716db141-d575-449a-9485-3681422e98df'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:21 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:21 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-61fee7ce-2659-45d2-9e86-a34f16adf3b9-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-61fee7ce-2659-45d2-9e86-a34f16adf3b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-61fee7ce-2659-45d2-9e86-a34f16adf3b9" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-61fee7ce-2659-45d2-9e86-a34f16adf3b9" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50405b-9080-43f1-8ded-5fa279f9128e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:22 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.358s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:22 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Deleted volume successfully. Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ae8a8cb-84c7-4c1b-99b8-2986e2f171e6 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-a5fa07d3-0fbb-4b7b-81cb-ddc39c6aa661-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:22 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 Nov 05 16:21:22 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:22 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9" returned: 0 in 0.404s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:22 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9 Nov 05 16:21:22 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:22 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-61fee7ce-2659-45d2-9e86-a34f16adf3b9" returned: 0 in 0.324s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-61fee7ce-2659-45d2-9e86-a34f16adf3b9" released by "delete_volume" :: held 0.786s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created reservations ['1d5cc9de-6084-4324-afbe-58a9e984ef34', '6be56d89-f6f8-45f3-85cd-47165293ffae', '6752f378-d71b-4d0e-9251-0af43a8c2960', 'a19c3f11-afec-4fba-870c-184d8b425cc8'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:22 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:22 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-bea9443b-5753-4dc0-b830-a633eabda59f-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-bea9443b-5753-4dc0-b830-a633eabda59f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-bdd0f986-4c48-4587-8dec-8d450c524797 req-c5bdb3ce-2972-4096-ba60-acb51f4ca400 tempest-TestInstancesWithCinderVolumes-329544364 None] Terminate volume connection completed successfully. Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-bdd0f986-4c48-4587-8dec-8d450c524797 req-c5bdb3ce-2972-4096-ba60-acb51f4ca400 tempest-TestInstancesWithCinderVolumes-329544364 None] Deleting attachment 750fcdb9-a865-455f-9ad8-aedf7a16ddcd. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-bea9443b-5753-4dc0-b830-a633eabda59f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:23 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-bea9443b-5753-4dc0-b830-a633eabda59f" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.304s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Deleted volume successfully. Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e12901-78c7-4de7-ad1f-87b055e65115]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2d6f224d-cd56-4a58-a04d-81495c917192 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-61fee7ce-2659-45d2-9e86-a34f16adf3b9-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:23 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f Nov 05 16:21:23 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:23 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:23 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f Nov 05 16:21:23 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "cinder-c60346b7-670e-4b8f-8318-00c1562df1d9-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-c60346b7-670e-4b8f-8318-00c1562df1d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "cinder-quobyte-c60346b7-670e-4b8f-8318-00c1562df1d9" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-quobyte-c60346b7-670e-4b8f-8318-00c1562df1d9" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b47efcb-8f86-47d1-8e04-f2588bf80320]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:23 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bea9443b-5753-4dc0-b830-a633eabda59f" returned: 0 in 0.310s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-bea9443b-5753-4dc0-b830-a633eabda59f" released by "delete_volume" :: held 0.757s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created reservations ['4fad2616-fd13-4277-88dc-b2eee8ed22b9', '57486996-35f6-4d39-9d3c-2b62f8d8d190', 'c7766ca1-f25b-4181-a0b0-ce8315b67df2', '7664752f-5451-4a54-af75-37bcc5062835'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:24 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 Nov 05 16:21:24 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:24 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:24 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-3f471554-5ce8-4705-af16-e63988104079-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-3f471554-5ce8-4705-af16-e63988104079-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:24 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-3f471554-5ce8-4705-af16-e63988104079" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9" returned: 0 in 0.538s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:24 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.385s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-3f471554-5ce8-4705-af16-e63988104079" acquired by "delete_volume" :: waited 0.054s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:24 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9 Nov 05 16:21:24 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:24 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Deleted volume successfully. Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a13808a-3ae0-46bc-bc1c-cf3df519326f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-31f837fa-5338-4859-9cf2-25ea13f7ffc1 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-bea9443b-5753-4dc0-b830-a633eabda59f-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:24 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 Nov 05 16:21:24 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:24 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c60346b7-670e-4b8f-8318-00c1562df1d9" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-quobyte-c60346b7-670e-4b8f-8318-00c1562df1d9" released by "delete_volume" :: held 0.983s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:24 devstack cinder-volume[86924]: WARNING cinder.quota [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-232300791-698260502 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-232300791-698260502, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:21:24 devstack cinder-volume[86924]: WARNING cinder.quota [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-232300791-698260502 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-232300791-698260502, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:21:24 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Created reservations ['896e6835-f871-456b-8db5-8b17606e1e50', '050cce1b-9e87-45bd-9a4a-0c36ad5edd85', '989c3fc3-b3a3-47b3-b87a-3cc4eb6eedd4', '4601c7b4-5450-43a0-a417-76e2bf857b85'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:25 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079" returned: 0 in 0.513s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:25 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:25 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:25 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079 Nov 05 16:21:25 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:25 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Deleted volume successfully. Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-74405a55-f64f-4d1e-8bb1-168ab0dac2e4 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-c60346b7-670e-4b8f-8318-00c1562df1d9-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:25 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3f471554-5ce8-4705-af16-e63988104079" returned: 0 in 0.324s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-3f471554-5ce8-4705-af16-e63988104079" released by "delete_volume" :: held 0.914s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created reservations ['b13f8f59-03c4-4050-bd07-e86db26510d9', '3c073a12-3461-44fe-a5d4-861df81da4b0', '592e124d-3dc6-4a0b-969b-18dd7f7a7df5', 'b0643ce1-e0c6-4b59-8ef3-76dff2a47b4f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:25 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:25 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:25 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.289s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Deleted volume successfully. Nov 05 16:21:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8228c24e-2664-448b-94ff-c0a8a85501c4 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-3f471554-5ce8-4705-af16-e63988104079-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-4a030d42-4b70-409d-a641-ffc7ec8fb7e6-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-4a030d42-4b70-409d-a641-ffc7ec8fb7e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-4a030d42-4b70-409d-a641-ffc7ec8fb7e6" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-4a030d42-4b70-409d-a641-ffc7ec8fb7e6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Deleting offline snapshot 4a030d42-4b70-409d-a641-ffc7ec8fb7e6 of volume eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] snapshot_file for this snap is: volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f26df9b-9075-49a9-8771-b12d11455c05]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:26 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 Nov 05 16:21:26 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:27 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6" returned: 0 in 0.433s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:21:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef7da5-0468-4174-86a9-7d4d93aa2ef1]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:27 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac Nov 05 16:21:27 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:27 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" returned: 0 in 0.432s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:27 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 Nov 05 16:21:27 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-511a1686-7af4-4b40-8138-13e746425ae1 req-69dbfa93-7207-459f-b9d6-f41f24bcf46c tempest-TestInstancesWithCinderVolumes-329544364 None] Terminate volume connection completed successfully. Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-511a1686-7af4-4b40-8138-13e746425ae1 req-69dbfa93-7207-459f-b9d6-f41f24bcf46c tempest-TestInstancesWithCinderVolumes-329544364 None] Deleting attachment 70b2b74a-96ba-4b24-82d7-718d8267f711. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:21:28 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6" returned: 0 in 0.432s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:28 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6 Nov 05 16:21:28 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:28 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac.4a030d42-4b70-409d-a641-ffc7ec8fb7e6" returned: 0 in 0.278s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-4a030d42-4b70-409d-a641-ffc7ec8fb7e6" released by "_delete_snapshot" :: held 1.710s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" released by "delete_snapshot" :: held 1.742s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created reservations ['70ff7198-bca3-41a0-8aa2-ecf919d5dbe8', '753e0efe-a482-48d5-a376-c3caa6cf0630', '1f200e22-1565-4cfe-ad54-67548a94e40a', 'f6f2a66a-4c26-42b5-8b8e-076dd2d77d27'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Delete snapshot completed successfully. Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-adbccf83-6d2d-4b2b-aab5-a4c943521005 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-4a030d42-4b70-409d-a641-ffc7ec8fb7e6-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "cinder-ccb711e2-85ae-4b3e-afe8-8f180b55e694-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-ccb711e2-85ae-4b3e-afe8-8f180b55e694-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "cinder-quobyte-ccb711e2-85ae-4b3e-afe8-8f180b55e694" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-quobyte-ccb711e2-85ae-4b3e-afe8-8f180b55e694" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3d2f24-68b9-459c-b19d-10ad551a280f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "cinder-quobyte-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:29 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 Nov 05 16:21:29 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1c429-0ac9-4045-9baa-7c9fd089aa3f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:29 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac Nov 05 16:21:29 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:29 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694" returned: 0 in 0.486s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:29 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694 Nov 05 16:21:29 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:29 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" returned: 0 in 0.476s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:29 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac Nov 05 16:21:29 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:29 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ccb711e2-85ae-4b3e-afe8-8f180b55e694" returned: 0 in 0.325s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-quobyte-ccb711e2-85ae-4b3e-afe8-8f180b55e694" released by "delete_volume" :: held 0.883s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:29 devstack cinder-volume[86924]: WARNING cinder.quota [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2142622073-9411794 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2142622073-9411794, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:21:29 devstack cinder-volume[86924]: WARNING cinder.quota [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2142622073-9411794 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2142622073-9411794, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Created reservations ['d75d0b15-41ae-4709-b856-602f169419bd', '939ed7a3-1a64-44f6-bdf4-dcee6fbbe41e', '968c2859-9a13-42b3-8403-a1aff65e167f', '3bda633f-65e1-4342-bcbd-4bbb408f6e6c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:29 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-quobyte-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac" released by "delete_volume" :: held 0.982s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:30 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:30 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Created reservations ['f0abe408-dcd9-4643-843e-743b5e3a92e6', 'c3d15340-8f11-4bb9-b06b-2d1d1da1f873', '1e465307-9d4d-4506-8fd2-90faed9fb46b', '4eeb0ae8-03f3-45ca-a1d6-73b7282e26cb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:30 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:30 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:30 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Deleted volume successfully. Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-49185aaa-468f-4a3b-a5b8-eeff2b7c7ffa tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-ccb711e2-85ae-4b3e-afe8-8f180b55e694-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:30 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.305s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Deleted volume successfully. Nov 05 16:21:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-289b8cb6-fa84-4577-b405-45abb43d6178 tempest-CreateVolumesFromSnapshotTest-1348577234 None] Lock "cinder-eb2a0fdf-3c6f-4bb7-bebf-d6c783b1d4ac-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:34 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-cad00c70-9edf-4e5b-bb3d-16ff212872f5 req-d1e36690-e1bd-40b0-9105-5908d64ec11b tempest-TestInstancesWithCinderVolumes-329544364 None] Terminate volume connection completed successfully. Nov 05 16:21:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-cad00c70-9edf-4e5b-bb3d-16ff212872f5 req-d1e36690-e1bd-40b0-9105-5908d64ec11b tempest-TestInstancesWithCinderVolumes-329544364 None] Deleting attachment e1dc7128-a1e1-46e6-aac8-3c7a0deada6b. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (a093c9ad-bda3-4abd-92c4-98260b3d9cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846af89a-4e46-4c91-a2e5-1f2486f33ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846af89a-4e46-4c91-a2e5-1f2486f33ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-684886957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cc7016-f592-4906-91ae-fa948b0fa215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:35Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60513fac-ce78-4f99-ac3f-526e1473a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60513fac-ce78-4f99-ac3f-526e1473a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93be3741-0fbb-4f55-ac9d-521d492e9dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93be3741-0fbb-4f55-ac9d-521d492e9dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65cc7016-f592-4906-91ae-fa948b0fa215', 'volume_name': 'volume-65cc7016-f592-4906-91ae-fa948b0fa215', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923138c5-dcda-4d16-818f-d0db490a4320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923138c5-dcda-4d16-818f-d0db490a4320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ece604f-e50c-45eb-b86a-776f6565e142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:35 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume 65cc7016-f592-4906-91ae-fa948b0fa215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65cc7016-f592-4906-91ae-fa948b0fa215', 'volume_size': 1} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-684886957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cc7016-f592-4906-91ae-fa948b0fa215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:35Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Creating volume 65cc7016-f592-4906-91ae-fa948b0fa215 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:35 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:35 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 1073741824 Nov 05 16:21:35 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "cinder-0bf5cc51-566b-4518-a388-36e35852968d-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-0bf5cc51-566b-4518-a388-36e35852968d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "cinder-quobyte-0bf5cc51-566b-4518-a388-36e35852968d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-quobyte-0bf5cc51-566b-4518-a388-36e35852968d" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de75049-b1ec-4571-913a-f57bcb4e94cc]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:36 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 1073741824" returned: 0 in 0.603s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:36 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d Nov 05 16:21:36 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:36 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 Nov 05 16:21:36 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:36 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d" returned: 0 in 0.462s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:36 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215" returned: 0 in 0.332s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:36 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d Nov 05 16:21:36 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ece604f-e50c-45eb-b86a-776f6565e142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65cc7016-f592-4906-91ae-fa948b0fa215', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e8dd49-cc0f-4227-bc6f-c08067b16dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:36 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume volume-65cc7016-f592-4906-91ae-fa948b0fa215 (65cc7016-f592-4906-91ae-fa948b0fa215): created successfully Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e8dd49-cc0f-4227-bc6f-c08067b16dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (a093c9ad-bda3-4abd-92c4-98260b3d9cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-76290bd4-bd44-4198-93f0-844187d5d18c tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created volume successfully. Nov 05 16:21:36 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0bf5cc51-566b-4518-a388-36e35852968d" returned: 0 in 0.260s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-quobyte-0bf5cc51-566b-4518-a388-36e35852968d" released by "delete_volume" :: held 0.777s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:36 devstack cinder-volume[86924]: WARNING cinder.quota [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707153970-2089139450 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707153970-2089139450, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:21:36 devstack cinder-volume[86924]: WARNING cinder.quota [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707153970-2089139450 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-707153970-2089139450, it is now deprecated. Please use the default quota class for default quota. Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Created reservations ['bf350c64-5243-4a6b-9cfd-94a862aaa706', 'fa911f74-4583-401d-a4b8-f67e5a9ec369', 'f7d19519-3909-41c5-99f1-5d5e02af02a5', '717e9e33-493d-450c-abd9-859f35662d6f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:37 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:37 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:37 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.325s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:37 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Deleted volume successfully. Nov 05 16:21:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c5f111d3-6482-4f00-9e4b-6bd9025b9cc3 tempest-TestInstancesWithCinderVolumes-329544364 None] Lock "cinder-0bf5cc51-566b-4518-a388-36e35852968d-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (86c8d1c7-0bb3-4391-85c8-6584a5d28c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f5a221-bbfc-4d8a-9a4c-e10c0634fc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f5a221-bbfc-4d8a-9a4c-e10c0634fc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1428792322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482ef98c-7bb0-41cc-982f-1cc6184fa461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:38Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efe0ef0-73d4-4546-b2d1-862aa27b50ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efe0ef0-73d4-4546-b2d1-862aa27b50ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8bd7f6-c3e2-44b6-991e-f5146aedcbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8bd7f6-c3e2-44b6-991e-f5146aedcbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482ef98c-7bb0-41cc-982f-1cc6184fa461', 'volume_name': 'volume-482ef98c-7bb0-41cc-982f-1cc6184fa461', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5333fa-3ada-4c44-9573-ee039c09b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5333fa-3ada-4c44-9573-ee039c09b912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4621adc-90c6-4b3e-a7df-e2152174be80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume 482ef98c-7bb0-41cc-982f-1cc6184fa461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482ef98c-7bb0-41cc-982f-1cc6184fa461', 'volume_size': 1} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1428792322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482ef98c-7bb0-41cc-982f-1cc6184fa461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:38Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Creating volume 482ef98c-7bb0-41cc-982f-1cc6184fa461 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:38 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:38 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 1073741824 Nov 05 16:21:38 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:38 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (f499bb9b-0662-4066-9edb-a7daabcc17ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9072e2-48de-4614-9aca-441e6a0ca8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9072e2-48de-4614-9aca-441e6a0ca8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759440153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35b6671-4abc-4b12-b189-b07dd81bf8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:39Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e4c474-3204-4943-9a79-f6366cff19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e4c474-3204-4943-9a79-f6366cff19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf068e6-9255-442d-b82a-2b0c0845b25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf068e6-9255-442d-b82a-2b0c0845b25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35b6671-4abc-4b12-b189-b07dd81bf8fd', 'volume_name': 'volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82db81c1-1997-4324-bb24-f4589e721218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82db81c1-1997-4324-bb24-f4589e721218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b23b093-f69b-446b-bd5e-28b21007df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume a35b6671-4abc-4b12-b189-b07dd81bf8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd', 'volume_size': 1} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 1073741824" returned: 0 in 0.749s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:39 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 Nov 05 16:21:39 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:39 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461" returned: 0 in 0.372s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759440153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35b6671-4abc-4b12-b189-b07dd81bf8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:39Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Creating volume a35b6671-4abc-4b12-b189-b07dd81bf8fd {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:39 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:39 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd 1073741824 Nov 05 16:21:39 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4621adc-90c6-4b3e-a7df-e2152174be80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482ef98c-7bb0-41cc-982f-1cc6184fa461', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc83b59-6542-4b67-9172-8d323c224d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (4d56dc65-e60b-41f2-b9fa-0b2d8cb21d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e5d956-2e00-42f0-8a06-8d73ecf39967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 (482ef98c-7bb0-41cc-982f-1cc6184fa461): created successfully Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc83b59-6542-4b67-9172-8d323c224d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (86c8d1c7-0bb3-4391-85c8-6584a5d28c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e5d956-2e00-42f0-8a06-8d73ecf39967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936149148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0179297-3d3a-4dea-a8a1-75e5f2bfa374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:39Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61da43d0-8a4f-4aa8-8810-3b5eaba32c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61da43d0-8a4f-4aa8-8810-3b5eaba32c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb7f5b9-99da-435e-ac47-bdaa7d8ed303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb7f5b9-99da-435e-ac47-bdaa7d8ed303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0179297-3d3a-4dea-a8a1-75e5f2bfa374', 'volume_name': 'volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d09914-c29d-48f6-af3c-b4bb0634fadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d09914-c29d-48f6-af3c-b4bb0634fadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288d9393-eb86-4e66-b865-979c670b88cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume f0179297-3d3a-4dea-a8a1-75e5f2bfa374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374', 'volume_size': 1} Nov 05 16:21:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5ba2141c-a1b3-405a-b979-41ced76a5541 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created volume successfully. Nov 05 16:21:40 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd 1073741824" returned: 0 in 0.757s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (35fcbb2b-7ad2-426a-8bcf-129a86f8a0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712b5f1b-3b8c-4097-8033-650a3e824db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712b5f1b-3b8c-4097-8033-650a3e824db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282135018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71cfbd0-8367-4ed9-a6f7-0f941fd6a884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:40Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd Nov 05 16:21:40 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a5f3ee-ba3c-47a8-b2da-ba2396f7e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a5f3ee-ba3c-47a8-b2da-ba2396f7e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618fd1f9-bd94-4bf9-99d1-224a437fed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618fd1f9-bd94-4bf9-99d1-224a437fed98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71cfbd0-8367-4ed9-a6f7-0f941fd6a884', 'volume_name': 'volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c535274-bcdb-4a65-a9d3-3a4b5951357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c535274-bcdb-4a65-a9d3-3a4b5951357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53162e4c-b481-4a48-9b28-fb14ea93b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume b71cfbd0-8367-4ed9-a6f7-0f941fd6a884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884', 'volume_size': 1} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (49aa8bfe-61d6-40af-b660-76c029216781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0b79bf-9d94-4813-8aba-4d908a9ddbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0b79bf-9d94-4813-8aba-4d908a9ddbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13543640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf47aa79-b8c7-4b74-9114-d864891018c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:41Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac94f72-0b1e-4fef-ab52-c444554d4898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac94f72-0b1e-4fef-ab52-c444554d4898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9a3b1d-61ae-43df-9525-f3beefc27ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9a3b1d-61ae-43df-9525-f3beefc27ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf47aa79-b8c7-4b74-9114-d864891018c5', 'volume_name': 'volume-bf47aa79-b8c7-4b74-9114-d864891018c5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7993b8-712b-4480-827c-49d6e836bb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7993b8-712b-4480-827c-49d6e836bb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b3b479-dad1-4c30-bbeb-d50312383976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:40 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume bf47aa79-b8c7-4b74-9114-d864891018c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf47aa79-b8c7-4b74-9114-d864891018c5', 'volume_size': 1} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:40 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd" returned: 0 in 0.492s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936149148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0179297-3d3a-4dea-a8a1-75e5f2bfa374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:39Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Creating volume f0179297-3d3a-4dea-a8a1-75e5f2bfa374 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:41 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:41 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 1073741824 Nov 05 16:21:41 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b23b093-f69b-446b-bd5e-28b21007df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0249a06c-a8f2-4ed4-8040-dcc76a211bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:41 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd (a35b6671-4abc-4b12-b189-b07dd81bf8fd): created successfully Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0249a06c-a8f2-4ed4-8040-dcc76a211bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (f499bb9b-0662-4066-9edb-a7daabcc17ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4863ea29-8190-4197-9734-abf3d3ec3fc8 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created volume successfully. Nov 05 16:21:41 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 1073741824" returned: 0 in 0.577s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:41 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 Nov 05 16:21:41 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:41 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374" returned: 0 in 0.278s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282135018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71cfbd0-8367-4ed9-a6f7-0f941fd6a884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:40Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Creating volume b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:41 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288d9393-eb86-4e66-b865-979c670b88cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2093a000-fe31-452a-ab9b-482edb102be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:41 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 1073741824 Nov 05 16:21:41 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:41 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 (f0179297-3d3a-4dea-a8a1-75e5f2bfa374): created successfully Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2093a000-fe31-452a-ab9b-482edb102be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (4d56dc65-e60b-41f2-b9fa-0b2d8cb21d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-892dac61-e518-4e23-a204-f9526998333d tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created volume successfully. Nov 05 16:21:42 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 1073741824" returned: 0 in 0.550s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:42 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 Nov 05 16:21:42 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:42 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884" returned: 0 in 0.297s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-13543640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf47aa79-b8c7-4b74-9114-d864891018c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101a052d40464996aac80119831dac06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:41Z,use_quota=True,user_id='aa859913136444a6acd9ab36f00c0448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Creating volume bf47aa79-b8c7-4b74-9114-d864891018c5 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:42 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53162e4c-b481-4a48-9b28-fb14ea93b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a76f07d-e45e-4610-98a5-f719498a59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:42 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 1073741824 Nov 05 16:21:42 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:42 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 (b71cfbd0-8367-4ed9-a6f7-0f941fd6a884): created successfully Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a76f07d-e45e-4610-98a5-f719498a59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (35fcbb2b-7ad2-426a-8bcf-129a86f8a0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bf2a337a-1521-48ec-a679-8cdc0953df4b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created volume successfully. Nov 05 16:21:43 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 1073741824" returned: 0 in 0.491s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:43 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 Nov 05 16:21:43 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:43 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b3b479-dad1-4c30-bbeb-d50312383976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf47aa79-b8c7-4b74-9114-d864891018c5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e8edb9-51fc-4fc4-8ec4-79f1acce1080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Volume volume-bf47aa79-b8c7-4b74-9114-d864891018c5 (bf47aa79-b8c7-4b74-9114-d864891018c5): created successfully Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e8edb9-51fc-4fc4-8ec4-79f1acce1080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Flow 'volume_create_manager' (49aa8bfe-61d6-40af-b660-76c029216781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-57470224-765f-47e7-995d-35340d41311b tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created volume successfully. Nov 05 16:21:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-bf47aa79-b8c7-4b74-9114-d864891018c5-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-bf47aa79-b8c7-4b74-9114-d864891018c5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-quobyte-bf47aa79-b8c7-4b74-9114-d864891018c5" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-bf47aa79-b8c7-4b74-9114-d864891018c5" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c681255-a0b7-4562-91f9-66dc7f304a3c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:44 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 Nov 05 16:21:44 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:45 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5" returned: 0 in 0.473s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:45 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5 Nov 05 16:21:45 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:45 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-bf47aa79-b8c7-4b74-9114-d864891018c5" returned: 0 in 0.260s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-bf47aa79-b8c7-4b74-9114-d864891018c5" released by "delete_volume" :: held 0.788s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created reservations ['6c263f23-7b35-4ca4-8f5a-4c58b1d3dee3', 'aaa1d456-7162-4249-a7bc-534326051070', 'da6858f4-f7bf-464b-82d0-a84213fb1643', '0b5df486-02f0-42f7-8d79-9490d552e782'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:45 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:45 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-quobyte-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884" acquired by "delete_volume" :: waited 0.037s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e7fcb-155b-475d-87c2-489aef21a103]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:46 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.518s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Deleted volume successfully. Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fcfd926-27eb-4a13-aaa6-e2dcfb4a5416 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-bf47aa79-b8c7-4b74-9114-d864891018c5-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:46 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 Nov 05 16:21:46 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:46 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:46 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884 Nov 05 16:21:46 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:46 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884" released by "delete_volume" :: held 0.807s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created reservations ['4ea68034-5cea-4e3c-a88d-f1dd6f56be30', 'a550b2d7-5595-4a94-9248-278aa9b766e9', '857b9fd1-d63f-4051-926e-eeef8403eebd', '7341d6d3-2a2e-4d10-939f-79f525d584ac'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:46 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:46 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-f0179297-3d3a-4dea-a8a1-75e5f2bfa374-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-f0179297-3d3a-4dea-a8a1-75e5f2bfa374-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-quobyte-f0179297-3d3a-4dea-a8a1-75e5f2bfa374" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-f0179297-3d3a-4dea-a8a1-75e5f2bfa374" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9afc7e-a277-451e-a4e0-6765ddd7f4ea]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:47 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Deleted volume successfully. Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-409bd281-24a6-4e4c-bc87-5ebce060bd33 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-b71cfbd0-8367-4ed9-a6f7-0f941fd6a884-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:47 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 Nov 05 16:21:47 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:47 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374" returned: 0 in 0.434s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:47 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374 Nov 05 16:21:47 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:47 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f0179297-3d3a-4dea-a8a1-75e5f2bfa374" returned: 0 in 0.302s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-f0179297-3d3a-4dea-a8a1-75e5f2bfa374" released by "delete_volume" :: held 0.809s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created reservations ['0762189c-b4aa-4a41-8fd8-4d394aa71c02', '0fffb0fd-0f3b-4639-a93b-b58fa9290378', 'b8209406-6454-476e-ac4a-3cc8d07e793a', '1be41a7a-dbe5-4d01-9b30-3d0b91ec2cf1'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:48 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:48 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-a35b6671-4abc-4b12-b189-b07dd81bf8fd-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-a35b6671-4abc-4b12-b189-b07dd81bf8fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-quobyte-a35b6671-4abc-4b12-b189-b07dd81bf8fd" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-a35b6671-4abc-4b12-b189-b07dd81bf8fd" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[889954c5-9f93-4792-afe2-f24cdada154d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:48 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.313s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:48 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Deleted volume successfully. Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c394b5ec-8bd7-4a8b-bc33-760edfd4de71 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-f0179297-3d3a-4dea-a8a1-75e5f2bfa374-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:48 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd Nov 05 16:21:48 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:48 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd" returned: 0 in 0.441s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:48 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd Nov 05 16:21:48 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:49 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a35b6671-4abc-4b12-b189-b07dd81bf8fd" returned: 0 in 0.320s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-a35b6671-4abc-4b12-b189-b07dd81bf8fd" released by "delete_volume" :: held 0.836s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created reservations ['ca3c556d-fc03-4647-a431-83bbe663cff5', 'ae123171-2154-44e8-93db-ace13c05ad5c', '3bb4d0be-fa56-4340-a7ae-d6e5ebfb57fe', '51bb6fd6-f385-45f1-aaaf-9179aa2440df'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:49 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:49 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-482ef98c-7bb0-41cc-982f-1cc6184fa461-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-482ef98c-7bb0-41cc-982f-1cc6184fa461-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-quobyte-482ef98c-7bb0-41cc-982f-1cc6184fa461" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-482ef98c-7bb0-41cc-982f-1cc6184fa461" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[06377f17-0fd3-4a49-8e04-cee667f6b7bf]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:49 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.428s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:49 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Deleted volume successfully. Nov 05 16:21:49 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 Nov 05 16:21:49 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0c3195c2-273d-433d-a63b-3f844de6d3a0 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-a35b6671-4abc-4b12-b189-b07dd81bf8fd-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:50 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461" returned: 0 in 0.453s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:50 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461 Nov 05 16:21:50 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:50 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:50 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:50 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.334s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:21:50 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-482ef98c-7bb0-41cc-982f-1cc6184fa461" returned: 0 in 0.393s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-482ef98c-7bb0-41cc-982f-1cc6184fa461" released by "delete_volume" :: held 0.922s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created reservations ['e0e9f42e-b250-4950-8e6c-afa2091939c6', 'e25f1631-a2d6-4b49-80df-f5acf8b2a0d7', '0f9cc3d2-d933-4072-99be-d407886216e7', '71fb7a68-77b5-41eb-8db5-b34e99ec73b3'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:50 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:50 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:51 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Deleted volume successfully. Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3bbc1275-2b3a-4de2-9ef9-cd6ab78eb548 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-482ef98c-7bb0-41cc-982f-1cc6184fa461-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-65cc7016-f592-4906-91ae-fa948b0fa215-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-65cc7016-f592-4906-91ae-fa948b0fa215-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "cinder-quobyte-65cc7016-f592-4906-91ae-fa948b0fa215" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-65cc7016-f592-4906-91ae-fa948b0fa215" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a3851-4304-4278-af70-841e0973e28d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:52 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 Nov 05 16:21:52 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:52 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215" returned: 0 in 0.491s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:52 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215 Nov 05 16:21:52 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:52 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-65cc7016-f592-4906-91ae-fa948b0fa215" returned: 0 in 0.330s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-quobyte-65cc7016-f592-4906-91ae-fa948b0fa215" released by "delete_volume" :: held 0.893s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Created reservations ['f2531ec7-66ba-40d5-a6ba-18f18c802d11', '647303df-e8ab-4fd9-b890-e6d582a0610b', '3f02d18c-ebb0-488a-8e78-8d149c005cd8', '46632299-7654-49f3-8c05-7e169ab2fcff'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:53 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:21:53 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:53 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.485s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:21:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Deleted volume successfully. Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3fb09778-4f64-4a82-a980-c9d4c99f7773 tempest-CreateVolumesFromSourceVolumeTest-722988528 None] Lock "cinder-65cc7016-f592-4906-91ae-fa948b0fa215-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Flow 'volume_create_manager' (d8f83cc2-876f-4d2f-a6a2-583cafdb476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccc7db5-3831-4204-909a-f810c5e61fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccc7db5-3831-4204-909a-f810c5e61fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1677035374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f878e26-48a6-436a-bf3b-81b4abd12686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0199b74ef5174d5097fb509255d7890c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:53Z,use_quota=True,user_id='2e23a42b84604cc5977a7d720b530783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e3fb26-9d65-4345-976f-dd2233d9f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e3fb26-9d65-4345-976f-dd2233d9f016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367ff7b4-677c-4a84-a461-bec2506b76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367ff7b4-677c-4a84-a461-bec2506b76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f878e26-48a6-436a-bf3b-81b4abd12686', 'volume_name': 'volume-8f878e26-48a6-436a-bf3b-81b4abd12686', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe72451c-27fa-4c51-b03d-c1ab5317e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe72451c-27fa-4c51-b03d-c1ab5317e183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a763edd8-99c5-46dc-a771-c7d75ccff3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:53 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Volume 8f878e26-48a6-436a-bf3b-81b4abd12686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f878e26-48a6-436a-bf3b-81b4abd12686', 'volume_size': 1} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1677035374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f878e26-48a6-436a-bf3b-81b4abd12686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0199b74ef5174d5097fb509255d7890c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:53Z,use_quota=True,user_id='2e23a42b84604cc5977a7d720b530783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Creating volume 8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:21:53 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:21:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:53 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 1073741824 Nov 05 16:21:53 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:54 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 1073741824" returned: 0 in 0.561s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:54 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 Nov 05 16:21:54 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:54 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686" returned: 0 in 0.324s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a763edd8-99c5-46dc-a771-c7d75ccff3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f878e26-48a6-436a-bf3b-81b4abd12686', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3aedd13-4e57-4f7e-bb57-7bb7165b1207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Volume volume-8f878e26-48a6-436a-bf3b-81b4abd12686 (8f878e26-48a6-436a-bf3b-81b4abd12686): created successfully Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3aedd13-4e57-4f7e-bb57-7bb7165b1207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Flow 'volume_create_manager' (d8f83cc2-876f-4d2f-a6a2-583cafdb476c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-63fb2689-0c8d-42b5-872c-83fb114ffb5a tempest-SnapshotDependencyTests-451569482 None] Created volume successfully. Nov 05 16:21:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:21:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:21:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Creating offline snapshot 2a420dca-607d-4aeb-9ae2-47a92f422404 of volume 8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:21:56 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d21856-1201-4c93-8f7e-1906ffc76c4b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:56 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 Nov 05 16:21:56 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:56 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686" returned: 0 in 0.419s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:56 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 1G Nov 05 16:21:56 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:56 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 1G" returned: 0 in 0.473s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f878e26-48a6-436a-bf3b-81b4abd12686 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:56 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f878e26-48a6-436a-bf3b-81b4abd12686 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 Nov 05 16:21:56 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:57 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f878e26-48a6-436a-bf3b-81b4abd12686 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404" returned: 0 in 0.321s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:57 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 is being set with open permissions: ugo+rw Nov 05 16:21:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:57 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 Nov 05 16:21:57 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:57 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404" returned: 0 in 0.277s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:57 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.info Nov 05 16:21:57 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:57 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.info" returned: 0 in 0.263s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:57 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.info is being set with open permissions: ugo+rw Nov 05 16:21:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:57 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.info Nov 05 16:21:57 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:58 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 05 16:21:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.info" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:21:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:21:58 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8a3f5761-a4b9-40c5-a945-0d382d269466 tempest-SnapshotDependencyTests-451569482 None] Create snapshot completed successfully Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Flow 'volume_create_manager' (a340dd56-785e-4b81-9b24-6f292aca2874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f4f664-614a-4d2d-bf09-16998d8743b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f4f664-614a-4d2d-bf09-16998d8743b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b886ad4d-db97-4d71-84a9-33cf144cbf82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcd866ce14b4b0ea011093fa55b44cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:59Z,use_quota=True,user_id='7480536d3c5e4b719ca66cd30d3f9d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212d51e8-f250-4b02-802c-1a104190590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212d51e8-f250-4b02-802c-1a104190590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d4c5ea-323e-4664-b74f-012340769285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d4c5ea-323e-4664-b74f-012340769285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b886ad4d-db97-4d71-84a9-33cf144cbf82', 'volume_name': 'volume-b886ad4d-db97-4d71-84a9-33cf144cbf82', 'volume_size': 1, 'image_id': '61da59ad-eaca-48ca-9641-5193add8e5ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61da59ad-eaca-48ca-9641-5193add8e5ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e24ff115898252e5e75cc1b8487f2b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bcd866ce14b4b0ea011093fa55b44cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '009c2722dc97ef51d850306cd0d3c26e5c280ef40036e24751a7b7339c9301fb4d10db24493b397ae785b2eff0c40ab91ce8462638c5029a50731c302b5fa71e', 'id': '61da59ad-eaca-48ca-9641-5193add8e5ad', 'created_at': datetime.datetime(2026, 11, 5, 15, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61da59ad-eaca-48ca-9641-5193add8e5ad/file', 'properties': {}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eeb254-8873-40a5-b00c-93f93a10f896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eeb254-8873-40a5-b00c-93f93a10f896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2164d97-5352-4d23-bf52-90ea7f489e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Volume b886ad4d-db97-4d71-84a9-33cf144cbf82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b886ad4d-db97-4d71-84a9-33cf144cbf82', 'volume_size': 1, 'image_id': '61da59ad-eaca-48ca-9641-5193add8e5ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61da59ad-eaca-48ca-9641-5193add8e5ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e24ff115898252e5e75cc1b8487f2b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bcd866ce14b4b0ea011093fa55b44cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '009c2722dc97ef51d850306cd0d3c26e5c280ef40036e24751a7b7339c9301fb4d10db24493b397ae785b2eff0c40ab91ce8462638c5029a50731c302b5fa71e', 'id': '61da59ad-eaca-48ca-9641-5193add8e5ad', 'created_at': datetime.datetime(2026, 11, 5, 15, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61da59ad-eaca-48ca-9641-5193add8e5ad/file', 'properties': {}}, 'image_service': } Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Trying to clone b886ad4d-db97-4d71-84a9-33cf144cbf82 from image 61da59ad-eaca-48ca-9641-5193add8e5ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/61da59ad-eaca-48ca-9641-5193add8e5ad', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:21:59 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Image download 0.00 MB at 0.00 MB/s Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5628dd33-cd33-455a-b639-6a18b638ccdc]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:21:59 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD Nov 05 16:21:59 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Flow 'volume_create_manager' (7de35a99-f799-41b0-a482-feb8855394a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba710e-2569-4869-b4c5-7a5d0cdf7156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba710e-2569-4869-b4c5-7a5d0cdf7156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2a5ecf-95c5-4c21-b917-e67e22601162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0199b74ef5174d5097fb509255d7890c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a420dca-607d-4aeb-9ae2-47a92f422404,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:22:00Z,use_quota=True,user_id='2e23a42b84604cc5977a7d720b530783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509a00f7-d4ca-4b54-8316-a63847842c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509a00f7-d4ca-4b54-8316-a63847842c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3520f000-93d0-4a93-9739-6d45849acde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3520f000-93d0-4a93-9739-6d45849acde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c2a5ecf-95c5-4c21-b917-e67e22601162', 'volume_name': 'volume-5c2a5ecf-95c5-4c21-b917-e67e22601162', 'volume_size': 1, 'snapshot_id': '2a420dca-607d-4aeb-9ae2-47a92f422404'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778b6840-0eb2-4847-a5ac-706f92918a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778b6840-0eb2-4847-a5ac-706f92918a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:21:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2c980c-525b-4c1e-a66d-a93bc0a1932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:21:59 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Volume 5c2a5ecf-95c5-4c21-b917-e67e22601162: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c2a5ecf-95c5-4c21-b917-e67e22601162', 'volume_size': 1, 'snapshot_id': '2a420dca-607d-4aeb-9ae2-47a92f422404'} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-quobyte-2a420dca-607d-4aeb-9ae2-47a92f422404-5c2a5ecf-95c5-4c21-b917-e67e22601162" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-2a420dca-607d-4aeb-9ae2-47a92f422404-5c2a5ecf-95c5-4c21-b917-e67e22601162" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Creating volume 5c2a5ecf-95c5-4c21-b917-e67e22601162 from snapshot 2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-quobyte-5c2a5ecf-95c5-4c21-b917-e67e22601162" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:00 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-5c2a5ecf-95c5-4c21-b917-e67e22601162" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] snapshot: 2a420dca-607d-4aeb-9ae2-47a92f422404, volume: 5c2a5ecf-95c5-4c21-b917-e67e22601162, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7219df60-9ee9-46fb-93b7-aaf3c7bfdbbb]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:00 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD Nov 05 16:22:00 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:00 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 Nov 05 16:22:00 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:00 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Temporary image 61da59ad-eaca-48ca-9641-5193add8e5ad is fetched for user 7480536d3c5e4b719ca66cd30d3f9d88. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e372851-482d-4f9d-a7ae-c4a5b636f815]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:00 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404" returned: 0 in 0.488s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f878e26-48a6-436a-bf3b-81b4abd12686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:22:00 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD Nov 05 16:22:00 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[41748ed1-415d-4bd3-9d44-cfcacaa5b0fd]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:00 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 Nov 05 16:22:00 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:00 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:01 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD Nov 05 16:22:01 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:01 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686" returned: 0 in 0.492s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:01 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 Nov 05 16:22:01 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:01 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:22:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:08 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162" returned: 0 in 7.810s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:08 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:22:08 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Converted 1024.00 MB image at 131.10 MB/s Nov 05 16:22:08 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 is being set with open permissions: ugo+rw Nov 05 16:22:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:09 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 Nov 05 16:22:09 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:09 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-5c2a5ecf-95c5-4c21-b917-e67e22601162" released by "_copy_volume_from_snapshot" :: held 9.185s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=170,cinder:UPDATE=205,cinder:INSERT=42,cinder:DELETE=13 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=197,cinder:SELECT=143,cinder:INSERT=53,cinder:DELETE=22 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-2a420dca-607d-4aeb-9ae2-47a92f422404-5c2a5ecf-95c5-4c21-b917-e67e22601162" released by "_create_volume_from_snapshot" :: held 9.281s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.307s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.952s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b886ad4d-db97-4d71-84a9-33cf144cbf82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bcd866ce14b4b0ea011093fa55b44cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:21:59Z,use_quota=True,user_id='7480536d3c5e4b719ca66cd30d3f9d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Creating volume b886ad4d-db97-4d71-84a9-33cf144cbf82 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:22:09 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:09 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 1073741824 Nov 05 16:22:09 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2c980c-525b-4c1e-a66d-a93bc0a1932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2a5ecf-95c5-4c21-b917-e67e22601162', 'volume_size': 1, 'snapshot_id': '2a420dca-607d-4aeb-9ae2-47a92f422404'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e38e73-25cf-4098-b0c7-d590c08f88c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:09 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Volume volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 (5c2a5ecf-95c5-4c21-b917-e67e22601162): created successfully Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e38e73-25cf-4098-b0c7-d590c08f88c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Flow 'volume_create_manager' (7de35a99-f799-41b0-a482-feb8855394a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-343e1381-5858-429b-8a30-7c537de92528 tempest-SnapshotDependencyTests-451569482 None] Created volume successfully. Nov 05 16:22:09 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 1073741824" returned: 0 in 0.485s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:09 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 Nov 05 16:22:09 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-2a420dca-607d-4aeb-9ae2-47a92f422404-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-2a420dca-607d-4aeb-9ae2-47a92f422404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-quobyte-8f878e26-48a6-436a-bf3b-81b4abd12686" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-8f878e26-48a6-436a-bf3b-81b4abd12686" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-quobyte-2a420dca-607d-4aeb-9ae2-47a92f422404" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-2a420dca-607d-4aeb-9ae2-47a92f422404" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Deleting offline snapshot 2a420dca-607d-4aeb-9ae2-47a92f422404 of volume 8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] snapshot_file for this snap is: volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7291b3cc-067f-499e-9be4-64b62a0ef014]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:10 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82" returned: 0 in 0.317s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:10 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 Nov 05 16:22:10 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Attempting download of 61da59ad-eaca-48ca-9641-5193add8e5ad ((None, [{'url': 'file:///opt/stack/data/glance/images/61da59ad-eaca-48ca-9641-5193add8e5ad', 'metadata': {}}])) to volume b886ad4d-db97-4d71-84a9-33cf144cbf82. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b3516-350f-44c0-b12e-c9f15c659531]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61da59ad-eaca-48ca-9641-5193add8e5ad_f827wd1a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:10 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61da59ad-eaca-48ca-9641-5193add8e5ad_f827wd1a Nov 05 16:22:10 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:10 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404" returned: 0 in 0.447s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f878e26-48a6-436a-bf3b-81b4abd12686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca5bd3-5147-44d1-8da4-e696a1ce11ad]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:10 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61da59ad-eaca-48ca-9641-5193add8e5ad_f827wd1a" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61da59ad-eaca-48ca-9641-5193add8e5ad_f827wd1a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:10 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 Nov 05 16:22:10 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:10 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61da59ad-eaca-48ca-9641-5193add8e5ad_f827wd1a Nov 05 16:22:10 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:10 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61da59ad-eaca-48ca-9641-5193add8e5ad_f827wd1a" returned: 1 in 0.339s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61da59ad-eaca-48ca-9641-5193add8e5ad_f827wd1a' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8c40db-8c55-412d-ab28-7e08e6a4625a]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:11 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD Nov 05 16:22:11 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:11 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686" returned: 0 in 0.594s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:11 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 Nov 05 16:22:11 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:11 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:11 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD Nov 05 16:22:11 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:11 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:11 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404 Nov 05 16:22:11 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:11 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] 61da59ad-eaca-48ca-9641-5193add8e5ad was raw, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:11 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 Nov 05 16:22:11 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:11 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686.2a420dca-607d-4aeb-9ae2-47a92f422404" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-2a420dca-607d-4aeb-9ae2-47a92f422404" released by "_delete_snapshot" :: held 1.836s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-8f878e26-48a6-436a-bf3b-81b4abd12686" released by "delete_snapshot" :: held 1.870s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Created reservations ['79966466-5a57-49bb-bfa2-4e3f273ebce5', 'aac47b61-f311-4e1c-938c-abb177515424', '6b0f7249-cc0c-4112-b3c4-10b96dbb850e', 'e100fd1f-57fc-4db2-95e0-759f676ea7cf'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:22:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Delete snapshot completed successfully. Nov 05 16:22:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f3ad934d-828b-4850-900e-7d10947815ea tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-2a420dca-607d-4aeb-9ae2-47a92f422404-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-8f878e26-48a6-436a-bf3b-81b4abd12686-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-8f878e26-48a6-436a-bf3b-81b4abd12686-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-quobyte-8f878e26-48a6-436a-bf3b-81b4abd12686" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-8f878e26-48a6-436a-bf3b-81b4abd12686" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e3bd3e-0e8c-4efc-9df0-f260ce516ecd]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:12 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82" returned: 0 in 0.601s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61da59ad-eaca-48ca-9641-5193add8e5ad_34awdyo6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:22:12 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:12 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 Nov 05 16:22:12 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:12 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 1G Nov 05 16:22:12 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:12 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686" returned: 0 in 0.406s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:12 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 1G" returned: 0 in 0.347s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Downloaded image 61da59ad-eaca-48ca-9641-5193add8e5ad ((None, [{'url': 'file:///opt/stack/data/glance/images/61da59ad-eaca-48ca-9641-5193add8e5ad', 'metadata': {}}])) to volume b886ad4d-db97-4d71-84a9-33cf144cbf82 successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Temporary image 61da59ad-eaca-48ca-9641-5193add8e5ad for user 7480536d3c5e4b719ca66cd30d3f9d88 is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Marking volume b886ad4d-db97-4d71-84a9-33cf144cbf82 as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:22:12 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686 Nov 05 16:22:12 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Copying metadata from image 61da59ad-eaca-48ca-9641-5193add8e5ad to b886ad4d-db97-4d71-84a9-33cf144cbf82. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Creating volume glance metadata for volume b886ad4d-db97-4d71-84a9-33cf144cbf82 backed by image 61da59ad-eaca-48ca-9641-5193add8e5ad with: {'image_id': '61da59ad-eaca-48ca-9641-5193add8e5ad', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4e24ff115898252e5e75cc1b8487f2b6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2164d97-5352-4d23-bf52-90ea7f489e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b886ad4d-db97-4d71-84a9-33cf144cbf82', 'volume_size': 1, 'image_id': '61da59ad-eaca-48ca-9641-5193add8e5ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/61da59ad-eaca-48ca-9641-5193add8e5ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e24ff115898252e5e75cc1b8487f2b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bcd866ce14b4b0ea011093fa55b44cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '009c2722dc97ef51d850306cd0d3c26e5c280ef40036e24751a7b7339c9301fb4d10db24493b397ae785b2eff0c40ab91ce8462638c5029a50731c302b5fa71e', 'id': '61da59ad-eaca-48ca-9641-5193add8e5ad', 'created_at': datetime.datetime(2026, 11, 5, 15, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61da59ad-eaca-48ca-9641-5193add8e5ad/file', 'properties': {}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257fa473-05aa-4e62-8090-e73ed1f7b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:12 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Volume volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 (b886ad4d-db97-4d71-84a9-33cf144cbf82): created successfully Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257fa473-05aa-4e62-8090-e73ed1f7b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Flow 'volume_create_manager' (a340dd56-785e-4b81-9b24-6f292aca2874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0ffd201c-03dc-4443-b4e4-3079307614c1 tempest-VolumeImageDependencyTests-795817029 None] Created volume successfully. Nov 05 16:22:12 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8f878e26-48a6-436a-bf3b-81b4abd12686" returned: 0 in 0.294s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-8f878e26-48a6-436a-bf3b-81b4abd12686" released by "delete_volume" :: held 0.778s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Created reservations ['b95569d7-2b43-45ae-b222-de0293e5ff43', '3546044d-c8a4-4b9b-bf11-77a3ff15f2b2', 'aa0097eb-2128-4807-8c4a-cd93d3dca6b6', '06472690-d305-40fb-a372-c4ae07ec4d9e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:13 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:22:13 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-5c2a5ecf-95c5-4c21-b917-e67e22601162-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-5c2a5ecf-95c5-4c21-b917-e67e22601162-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:13 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:22:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Deleted volume successfully. Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bd44bb3d-3243-4778-afd6-b9f4cbace984 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-8f878e26-48a6-436a-bf3b-81b4abd12686-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "cinder-quobyte-5c2a5ecf-95c5-4c21-b917-e67e22601162" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-5c2a5ecf-95c5-4c21-b917-e67e22601162" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[11871923-6ab6-4b1c-bc50-0d565bc2666a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Acquiring lock "cinder-b886ad4d-db97-4d71-84a9-33cf144cbf82-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Lock "cinder-b886ad4d-db97-4d71-84a9-33cf144cbf82-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Acquiring lock "cinder-quobyte-b886ad4d-db97-4d71-84a9-33cf144cbf82" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:13 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 Nov 05 16:22:13 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Lock "cinder-quobyte-b886ad4d-db97-4d71-84a9-33cf144cbf82" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd3c4df-490a-4ed1-a999-b890b48d5746]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:13 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 Nov 05 16:22:13 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:13 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:13 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162 Nov 05 16:22:13 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:14 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82" returned: 0 in 0.414s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:14 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82 Nov 05 16:22:14 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:14 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5c2a5ecf-95c5-4c21-b917-e67e22601162" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-quobyte-5c2a5ecf-95c5-4c21-b917-e67e22601162" released by "delete_volume" :: held 0.707s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Created reservations ['3ef15c2e-66c6-4968-a03b-393e67826f0c', '8f258e42-a107-4c3d-9295-df2c6aecc0a2', '042d7b98-eb1f-4dec-a890-713060488935', '49d937d5-cece-4ce3-bb0f-1c14e8b29513'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:14 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:22:14 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:14 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b886ad4d-db97-4d71-84a9-33cf144cbf82" returned: 0 in 0.294s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Lock "cinder-quobyte-b886ad4d-db97-4d71-84a9-33cf144cbf82" released by "delete_volume" :: held 0.761s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Created reservations ['b6d1b5f3-e2be-4265-ae5c-59da49b9c917', 'f777a5b1-3371-48da-aa6b-366ac21776ad', '95760ef9-eb06-4fcb-a4f4-3054b83561dc', 'aeda001c-a274-4933-b4a3-4381aeb095f0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:14 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:14 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.428s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:14 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:22:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Deleted volume successfully. Nov 05 16:22:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-51cd2bc5-b89b-4487-9668-ab0fa23a84d8 tempest-SnapshotDependencyTests-451569482 None] Lock "cinder-5c2a5ecf-95c5-4c21-b917-e67e22601162-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:15 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.467s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:15 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:22:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Deleted volume successfully. Nov 05 16:22:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0379e990-6b40-4afd-9f14-83c30c9389ec tempest-VolumeImageDependencyTests-795817029 None] Lock "cinder-b886ad4d-db97-4d71-84a9-33cf144cbf82-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Flow 'volume_create_manager' (eebe234d-9027-4c71-961c-e42681a07fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fd7d15-0808-427e-8ffb-f3fa637a8ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fd7d15-0808-427e-8ffb-f3fa637a8ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363368350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a594c0-ccb1-45f0-996b-4320f243a4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee2f1fa68b04f5990f9ef5a7850114f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:22:22Z,use_quota=True,user_id='ac7a03bdc18146fea8991b0a82fb9200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f44936-8720-44c6-9b0e-21a2888fbe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f44936-8720-44c6-9b0e-21a2888fbe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2499559-b7e0-4667-9abe-b87549e2b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2499559-b7e0-4667-9abe-b87549e2b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a594c0-ccb1-45f0-996b-4320f243a4a1', 'volume_name': 'volume-11a594c0-ccb1-45f0-996b-4320f243a4a1', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2067dc-16ab-4518-ac4b-ed7b0f2b92f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2067dc-16ab-4518-ac4b-ed7b0f2b92f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d104d90-585a-4ac3-bb6a-90f91fb97376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:22 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Volume 11a594c0-ccb1-45f0-996b-4320f243a4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a594c0-ccb1-45f0-996b-4320f243a4a1', 'volume_size': 1} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363368350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a594c0-ccb1-45f0-996b-4320f243a4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee2f1fa68b04f5990f9ef5a7850114f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:22:22Z,use_quota=True,user_id='ac7a03bdc18146fea8991b0a82fb9200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Creating volume 11a594c0-ccb1-45f0-996b-4320f243a4a1 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:22:22 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:22:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:22 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 1073741824 Nov 05 16:22:22 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:23 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 1073741824" returned: 0 in 0.560s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:23 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 Nov 05 16:22:23 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:23 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1" returned: 0 in 0.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d104d90-585a-4ac3-bb6a-90f91fb97376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a594c0-ccb1-45f0-996b-4320f243a4a1', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b560969c-b6b6-4c38-8a9f-8e60acef62b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:23 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Volume volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 (11a594c0-ccb1-45f0-996b-4320f243a4a1): created successfully Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b560969c-b6b6-4c38-8a9f-8e60acef62b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Flow 'volume_create_manager' (eebe234d-9027-4c71-961c-e42681a07fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c664fde4-72ad-42a7-92f0-d261d904207f tempest-ProjectReaderTests-357579480 None] Created volume successfully. Nov 05 16:22:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Acquiring lock "cinder-11a594c0-ccb1-45f0-996b-4320f243a4a1-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Lock "cinder-11a594c0-ccb1-45f0-996b-4320f243a4a1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Acquiring lock "cinder-quobyte-11a594c0-ccb1-45f0-996b-4320f243a4a1" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Lock "cinder-quobyte-11a594c0-ccb1-45f0-996b-4320f243a4a1" acquired by "delete_volume" :: waited 0.047s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cef41b-728f-4176-87da-2e4e59a0a6f7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:25 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 Nov 05 16:22:25 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:25 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1" returned: 0 in 0.411s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:25 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1 Nov 05 16:22:25 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:25 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-11a594c0-ccb1-45f0-996b-4320f243a4a1" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Lock "cinder-quobyte-11a594c0-ccb1-45f0-996b-4320f243a4a1" released by "delete_volume" :: held 0.742s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Created reservations ['4102b90b-c19c-42bf-9b8c-b8b8085916d5', 'c67aa5b8-c1c2-4f4d-a057-9ed1380d380d', '1b8d94a7-a97e-4f28-b2bc-a8a073d37951', '21aeccb1-0118-40cd-9327-d680f3dbdb82'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:26 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:22:26 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:26 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.472s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:26 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:22:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Deleted volume successfully. Nov 05 16:22:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5ed2fc57-771e-4121-9e8c-c4f1c74ed650 tempest-ProjectReaderTests-357579480 None] Lock "cinder-11a594c0-ccb1-45f0-996b-4320f243a4a1-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:26 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:22:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Flow 'volume_create_manager' (e5cc2377-3351-4dfb-8761-d7ec74c1184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55afea7e-3e37-438d-9c3f-32d33e802a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55afea7e-3e37-438d-9c3f-32d33e802a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296189815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b29d5a-9a36-41c0-9d70-75c3b6ccd700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee2f1fa68b04f5990f9ef5a7850114f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:22:27Z,use_quota=True,user_id='ac7a03bdc18146fea8991b0a82fb9200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a29541-34e0-4e6b-b16b-6033cba5776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a29541-34e0-4e6b-b16b-6033cba5776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fedaa2f-edd2-4308-948c-c00d082e8b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fedaa2f-edd2-4308-948c-c00d082e8b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b29d5a-9a36-41c0-9d70-75c3b6ccd700', 'volume_name': 'volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9b2140-68eb-412c-8b9f-78e5fb3f00e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9b2140-68eb-412c-8b9f-78e5fb3f00e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a5d463-5ba2-457b-877c-f3b0d4b70353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:27 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Volume f6b29d5a-9a36-41c0-9d70-75c3b6ccd700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700', 'volume_size': 1} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296189815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b29d5a-9a36-41c0-9d70-75c3b6ccd700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee2f1fa68b04f5990f9ef5a7850114f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:22:27Z,use_quota=True,user_id='ac7a03bdc18146fea8991b0a82fb9200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Creating volume f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:22:27 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:27 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 1073741824 Nov 05 16:22:27 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:27 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 1073741824" returned: 0 in 0.633s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:27 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 Nov 05 16:22:27 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:28 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700" returned: 0 in 0.324s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a5d463-5ba2-457b-877c-f3b0d4b70353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eb7af7-feb4-4124-9816-08d7487817d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:28 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Volume volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 (f6b29d5a-9a36-41c0-9d70-75c3b6ccd700): created successfully Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36eb7af7-feb4-4124-9816-08d7487817d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Flow 'volume_create_manager' (e5cc2377-3351-4dfb-8761-d7ec74c1184e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a7ad3d79-4bc9-40e2-a39a-6d616d43450e tempest-ProjectReaderTests-357579480 None] Created volume successfully. Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Acquiring lock "cinder-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Lock "cinder-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Acquiring lock "cinder-quobyte-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:22:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Lock "cinder-quobyte-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:22:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece54ab-0e37-41bd-a6bb-17247a71cd11]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:22:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:29 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 Nov 05 16:22:29 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:29 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700" returned: 0 in 0.786s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:29 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700 Nov 05 16:22:29 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:30 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700" returned: 0 in 0.557s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Lock "cinder-quobyte-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700" released by "delete_volume" :: held 1.447s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Created reservations ['400905dd-a126-4e27-b384-4ff61cfa516e', '22ff8602-7e62-4a36-97e8-093b11e35505', '6aa88844-6e3d-499c-96c1-877970b449fd', '5b60d3fc-7dea-4c7d-b597-f0b0b04e29fb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:30 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:22:30 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:31 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.269s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:31 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:22:31 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Deleted volume successfully. Nov 05 16:22:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-32c8ee4d-5077-4a08-8cb4-38f0ee8734cf tempest-ProjectReaderTests-357579480 None] Lock "cinder-f6b29d5a-9a36-41c0-9d70-75c3b6ccd700-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Flow 'volume_create_manager' (f069cb21-7ab5-4939-a5fa-30ce4699c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3472b94-9958-49de-9dca-637e809ee1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3472b94-9958-49de-9dca-637e809ee1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1594729099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550a3f6b-3c45-42a4-afcf-0e35d83c9967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87566fc000b844a5a09ad1754a7eb67a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:22:33Z,use_quota=True,user_id='6fbc83b380084316b4dba899a327ef19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d129abaa-273d-400a-8abe-a92d661f77c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d129abaa-273d-400a-8abe-a92d661f77c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384e29d3-3bf0-463b-9756-6169f05ef9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384e29d3-3bf0-463b-9756-6169f05ef9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550a3f6b-3c45-42a4-afcf-0e35d83c9967', 'volume_name': 'volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3f8c44-75b0-4ed8-9228-4bc471e95c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3f8c44-75b0-4ed8-9228-4bc471e95c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e57003-7476-4aeb-b295-05ab93955c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Volume 550a3f6b-3c45-42a4-afcf-0e35d83c9967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967', 'volume_size': 1} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1594729099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550a3f6b-3c45-42a4-afcf-0e35d83c9967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87566fc000b844a5a09ad1754a7eb67a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:22:33Z,use_quota=True,user_id='6fbc83b380084316b4dba899a327ef19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Creating volume 550a3f6b-3c45-42a4-afcf-0e35d83c9967 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:22:33 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:33 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 1073741824 Nov 05 16:22:33 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:33 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 1073741824" returned: 0 in 0.500s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:34 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 Nov 05 16:22:34 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:34 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:22:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e57003-7476-4aeb-b295-05ab93955c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27792c6c-ae26-40c1-8c41-298e42f9dc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:22:34 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Volume volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 (550a3f6b-3c45-42a4-afcf-0e35d83c9967): created successfully Nov 05 16:22:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27792c6c-ae26-40c1-8c41-298e42f9dc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:22:34 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Flow 'volume_create_manager' (f069cb21-7ab5-4939-a5fa-30ce4699c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:22:34 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1ca3f08f-5e83-4f4f-8ce8-a2f1989b7f07 tempest-TestMinimumBasicScenario-1819740166 None] Created volume successfully. Nov 05 16:22:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f4689e78-c254-4687-bd18-6c681abdc900 req-670176e8-59be-46fa-82b6-d80b4ef2d37d tempest-TestMinimumBasicScenario-1819740166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f4689e78-c254-4687-bd18-6c681abdc900 req-670176e8-59be-46fa-82b6-d80b4ef2d37d tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [req-f4689e78-c254-4687-bd18-6c681abdc900 req-670176e8-59be-46fa-82b6-d80b4ef2d37d tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:36 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-f4689e78-c254-4687-bd18-6c681abdc900 req-670176e8-59be-46fa-82b6-d80b4ef2d37d tempest-TestMinimumBasicScenario-1819740166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff', 'name': 'volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3860f88-9fa9-48f9-924e-73582bfda75e', 'enforce_multipath': True} {{(pid=86924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 16:22:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-f4689e78-c254-4687-bd18-6c681abdc900 req-670176e8-59be-46fa-82b6-d80b4ef2d37d tempest-TestMinimumBasicScenario-1819740166 None] attachment_update completed successfully. Nov 05 16:22:46 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=56,cinder:INSERT=17,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:22:46 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=60,cinder:SELECT=43,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:22:50 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:22:50 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:22:50 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:22:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:23:09 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:23:24 devstack cinder-volume[86924]: INFO cinder.volume.manager [req-97286e3e-ca7b-4789-83c4-1d2920a1b1c9 req-5a013df6-b7f0-4078-b0eb-ad82cd926e0c tempest-TestMinimumBasicScenario-1819740166 None] Terminate volume connection completed successfully. Nov 05 16:23:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [req-97286e3e-ca7b-4789-83c4-1d2920a1b1c9 req-5a013df6-b7f0-4078-b0eb-ad82cd926e0c tempest-TestMinimumBasicScenario-1819740166 None] Deleting attachment c3860f88-9fa9-48f9-924e-73582bfda75e. {{(pid=86924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Acquiring lock "cinder-550a3f6b-3c45-42a4-afcf-0e35d83c9967-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Lock "cinder-550a3f6b-3c45-42a4-afcf-0e35d83c9967-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Acquiring lock "cinder-quobyte-550a3f6b-3c45-42a4-afcf-0e35d83c9967" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Lock "cinder-quobyte-550a3f6b-3c45-42a4-afcf-0e35d83c9967" acquired by "delete_volume" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8189f8-0c5e-4ff6-8133-c6611f7bf8f8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:25 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 Nov 05 16:23:25 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:25 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967" returned: 0 in 0.358s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:25 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967 Nov 05 16:23:25 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:25 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-550a3f6b-3c45-42a4-afcf-0e35d83c9967" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Lock "cinder-quobyte-550a3f6b-3c45-42a4-afcf-0e35d83c9967" released by "delete_volume" :: held 0.641s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Created reservations ['3e6cd68c-e2ae-4433-ba66-bfa5838b5807', 'daf41f8f-7a26-4c4a-924f-20f5989e2fc6', 'bcf91ec2-68cc-4035-83dc-3658a61b7290', '48b8ce61-7884-4802-aabf-917ea6a99ef6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:23:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:26 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:23:26 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:26 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:26 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:23:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Deleted volume successfully. Nov 05 16:23:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1428ed4b-befd-46a6-ad62-d2f74937d7a1 tempest-TestMinimumBasicScenario-1819740166 None] Lock "cinder-550a3f6b-3c45-42a4-afcf-0e35d83c9967-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:23:35 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:23:36 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:50 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:23:50 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:50 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:23:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Flow 'volume_create_manager' (dd798b2f-f1ec-4e84-af95-95b6198aa035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9deaeb6a-ae05-43aa-8419-b5b31a6f7473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9deaeb6a-ae05-43aa-8419-b5b31a6f7473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-377216599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b752135-da16-4643-a124-428bb1e63246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112ee93aac57466abbd3ad221cd42069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:23:57Z,use_quota=True,user_id='2c70ca3741054554a416fe348bb88d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d34418-19aa-4372-94a7-60664ac0a0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d34418-19aa-4372-94a7-60664ac0a0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac85558-93fc-4294-98af-b440eaa03153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac85558-93fc-4294-98af-b440eaa03153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b752135-da16-4643-a124-428bb1e63246', 'volume_name': 'volume-5b752135-da16-4643-a124-428bb1e63246', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316a4412-4162-45c4-b0ff-6bc4542329c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316a4412-4162-45c4-b0ff-6bc4542329c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415a9a8b-8d57-4340-9757-27c6a59487a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:23:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Volume 5b752135-da16-4643-a124-428bb1e63246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b752135-da16-4643-a124-428bb1e63246', 'volume_size': 1} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-377216599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b752135-da16-4643-a124-428bb1e63246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112ee93aac57466abbd3ad221cd42069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:23:57Z,use_quota=True,user_id='2c70ca3741054554a416fe348bb88d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Creating volume 5b752135-da16-4643-a124-428bb1e63246 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:23:56 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:23:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:56 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 1073741824 Nov 05 16:23:56 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:57 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 1073741824" returned: 0 in 0.419s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:57 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 Nov 05 16:23:57 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:57 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415a9a8b-8d57-4340-9757-27c6a59487a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b752135-da16-4643-a124-428bb1e63246', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58214f75-3319-4442-9517-a6fea2b455c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:23:57 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Volume volume-5b752135-da16-4643-a124-428bb1e63246 (5b752135-da16-4643-a124-428bb1e63246): created successfully Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58214f75-3319-4442-9517-a6fea2b455c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:23:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Flow 'volume_create_manager' (dd798b2f-f1ec-4e84-af95-95b6198aa035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:23:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-88163427-e700-4450-b670-1b496e9f28c7 tempest-TestImageHashVerification-1393147029 None] Created volume successfully. Nov 05 16:23:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:23:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:23:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79124256-9aca-4257-8cf3-8ffcbacd2884]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:23:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:58 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 Nov 05 16:23:58 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:58 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246" returned: 0 in 0.352s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8d281b-a820-4603-ae77-282b45d5902f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:23:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:58 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 Nov 05 16:23:58 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:23:59 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Nov 05 16:23:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246" returned: 0 in 0.365s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:23:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 /opt/stack/data/cinder/conversion/5b752135-da16-4643-a124-428bb1e63246.temp_image.64c77812-a7ea-4907-ab61-b77176511a4f0r6q6imm.img {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:23:59 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 /opt/stack/data/cinder/conversion/5b752135-da16-4643-a124-428bb1e63246.temp_image.64c77812-a7ea-4907-ab61-b77176511a4f0r6q6imm.img Nov 05 16:23:59 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:04 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 /opt/stack/data/cinder/conversion/5b752135-da16-4643-a124-428bb1e63246.temp_image.64c77812-a7ea-4907-ab61-b77176511a4f0r6q6imm.img" returned: 0 in 5.683s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:04 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[56437094-be3c-4f8a-a38f-f9bb6aab1f80]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:04 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 Nov 05 16:24:04 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:05 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246" returned: 0 in 0.516s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:05 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/conversion/5b752135-da16-4643-a124-428bb1e63246.temp_image.64c77812-a7ea-4907-ab61-b77176511a4f0r6q6imm.img {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:24:05 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Converted 1024.00 MB image at 180.15 MB/s Nov 05 16:24:05 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] 64c77812-a7ea-4907-ab61-b77176511a4f was raw, no need to convert to raw {{(pid=86924) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1191}} Nov 05 16:24:08 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:INSERT=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:24:15 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:24:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.537s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Uploaded volume to glance image-id: 64c77812-a7ea-4907-ab61-b77176511a4f. {{(pid=86924) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 16:24:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-df6bf4d4-b59f-4d03-8160-1c02506e7d05 tempest-TestImageHashVerification-1393147029 None] Copy volume to image completed successfully. Nov 05 16:24:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Acquiring lock "cinder-5b752135-da16-4643-a124-428bb1e63246-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Lock "cinder-5b752135-da16-4643-a124-428bb1e63246-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Acquiring lock "cinder-quobyte-5b752135-da16-4643-a124-428bb1e63246" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Lock "cinder-quobyte-5b752135-da16-4643-a124-428bb1e63246" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96825d5-d3c1-4859-97ff-5beffc752235]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:25 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 Nov 05 16:24:25 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:25 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:25 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246 Nov 05 16:24:25 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:25 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-5b752135-da16-4643-a124-428bb1e63246" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Lock "cinder-quobyte-5b752135-da16-4643-a124-428bb1e63246" released by "delete_volume" :: held 0.635s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Created reservations ['f4be1ea0-f95b-496d-9859-2ce9d9eae3c3', '357a6bc9-2842-40b2-bf91-fa28d82bef19', '3a3464b7-692b-442f-b260-c0354a2df8f2', 'b9366acc-c3a1-4b53-b563-cd714a17df7f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:25 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:25 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:25 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.239s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Deleted volume successfully. Nov 05 16:24:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b1a5473a-1078-4225-b261-feb7f139aa3d tempest-TestImageHashVerification-1393147029 None] Lock "cinder-5b752135-da16-4643-a124-428bb1e63246-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:35 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:24:35 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=9,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (e3ed7cae-a318-42fb-bec8-e951a618f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871ac21a-0999-4748-bbbf-791becd8ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871ac21a-0999-4748-bbbf-791becd8ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424578608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3199f0-a088-4098-8a19-1507b0392f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:37Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471a1f21-5e9b-47e2-919e-78409151e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471a1f21-5e9b-47e2-919e-78409151e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84353914-ef66-442e-94da-0b11d27ea667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84353914-ef66-442e-94da-0b11d27ea667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3199f0-a088-4098-8a19-1507b0392f26', 'volume_name': 'volume-ea3199f0-a088-4098-8a19-1507b0392f26', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562d2f80-bedd-4a3b-b526-40e617e58cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562d2f80-bedd-4a3b-b526-40e617e58cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2e16f-2ad2-4bb4-8300-81e69f3bb168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Volume ea3199f0-a088-4098-8a19-1507b0392f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3199f0-a088-4098-8a19-1507b0392f26', 'volume_size': 1} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424578608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3199f0-a088-4098-8a19-1507b0392f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:37Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Creating volume ea3199f0-a088-4098-8a19-1507b0392f26 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:37 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:37 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 1073741824 Nov 05 16:24:37 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (594fe8a9-2560-4b43-a04d-ef54aa29617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f6479b-f539-47cc-a3b5-0c79b895892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f6479b-f539-47cc-a3b5-0c79b895892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277663613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e36b4f-0e96-4dfb-8076-b0e5a8ce0289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:38Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80970bb7-2cfe-44e8-94db-5e666d6a70c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80970bb7-2cfe-44e8-94db-5e666d6a70c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc9f8b2-cadf-4e82-b88f-026555f51bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc9f8b2-cadf-4e82-b88f-026555f51bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e36b4f-0e96-4dfb-8076-b0e5a8ce0289', 'volume_name': 'volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ab0c61-cefa-4867-9cb2-5261382f67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ab0c61-cefa-4867-9cb2-5261382f67ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6eb295-5f0e-4051-814c-b50515e018a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Volume 07e36b4f-0e96-4dfb-8076-b0e5a8ce0289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289', 'volume_size': 1} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:37 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 1073741824" returned: 0 in 0.485s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:37 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 Nov 05 16:24:37 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (d9f9094b-86b4-4789-b2e9-bdb5fb58af13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae10ca13-d37f-4e06-943b-1f1aba5cd313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae10ca13-d37f-4e06-943b-1f1aba5cd313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436739855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f8c4ca-83cd-491e-b069-4e306025611f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:38Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69322983-d704-4fbc-9996-ddcfe2365faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69322983-d704-4fbc-9996-ddcfe2365faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fadf0a2-7fc3-4e94-8f96-367d1524519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fadf0a2-7fc3-4e94-8f96-367d1524519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f8c4ca-83cd-491e-b069-4e306025611f', 'volume_name': 'volume-12f8c4ca-83cd-491e-b069-4e306025611f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad9ae58-7f3b-4c0e-b20c-d69fa1a70b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad9ae58-7f3b-4c0e-b20c-d69fa1a70b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0851d1b5-71fc-45a4-a18e-50c1b054202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Volume 12f8c4ca-83cd-491e-b069-4e306025611f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f8c4ca-83cd-491e-b069-4e306025611f', 'volume_size': 1} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:38 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26" returned: 0 in 0.273s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-277663613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e36b4f-0e96-4dfb-8076-b0e5a8ce0289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:38Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Creating volume 07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2e16f-2ad2-4bb4-8300-81e69f3bb168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3199f0-a088-4098-8a19-1507b0392f26', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 1073741824 Nov 05 16:24:38 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ac6f3a-7a74-47b8-9fcb-30885a851790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Volume volume-ea3199f0-a088-4098-8a19-1507b0392f26 (ea3199f0-a088-4098-8a19-1507b0392f26): created successfully Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ac6f3a-7a74-47b8-9fcb-30885a851790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (e3ed7cae-a318-42fb-bec8-e951a618f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a2a5b151-6075-45d9-8a8b-954f1ed7b481 tempest-CreateVolumesFromImageTest-479949580 None] Created volume successfully. Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (f9da814d-c537-462b-a721-1b20efedd16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc01f720-ee99-43bd-8715-f997fab3f6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc01f720-ee99-43bd-8715-f997fab3f6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901264859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bfe92c-91b3-4dc6-a18f-b911dffe8d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:38Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae803219-4e0c-4a40-8892-64b0f8378ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae803219-4e0c-4a40-8892-64b0f8378ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2c819b-6e2a-4f8f-9810-1159c18b63d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2c819b-6e2a-4f8f-9810-1159c18b63d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6bfe92c-91b3-4dc6-a18f-b911dffe8d70', 'volume_name': 'volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68f5786-2d79-4706-98f3-82e594f256ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68f5786-2d79-4706-98f3-82e594f256ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c02e4d4-6933-4e93-a3d1-5f5d4c7c2e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Volume b6bfe92c-91b3-4dc6-a18f-b911dffe8d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70', 'volume_size': 1} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:38 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 1073741824" returned: 0 in 0.514s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:38 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 Nov 05 16:24:38 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (0b46352c-d6c4-4f53-8f2b-bd7228807475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7844266e-f924-4db9-a8b3-682b0659b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7844266e-f924-4db9-a8b3-682b0659b022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288721076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c2bfde-ae1d-4546-92ad-359d8066844d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:39Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d4155b-45d2-4a07-88f3-13a99748af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d4155b-45d2-4a07-88f3-13a99748af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b529dc-0a1b-4454-a91e-f81048fc6392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b529dc-0a1b-4454-a91e-f81048fc6392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c2bfde-ae1d-4546-92ad-359d8066844d', 'volume_name': 'volume-c3c2bfde-ae1d-4546-92ad-359d8066844d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6aefaa-6690-4692-9258-08783c4dba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6aefaa-6690-4692-9258-08783c4dba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e6ac7a-19d6-4833-ae5b-20db271eca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Volume c3c2bfde-ae1d-4546-92ad-359d8066844d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c2bfde-ae1d-4546-92ad-359d8066844d', 'volume_size': 1} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:38 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289" returned: 0 in 0.256s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436739855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f8c4ca-83cd-491e-b069-4e306025611f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:38Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Creating volume 12f8c4ca-83cd-491e-b069-4e306025611f {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6eb295-5f0e-4051-814c-b50515e018a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f 1073741824 Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7122f3e7-182e-475b-adb3-ceb37f9d9289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:38 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Volume volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 (07e36b4f-0e96-4dfb-8076-b0e5a8ce0289): created successfully Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7122f3e7-182e-475b-adb3-ceb37f9d9289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (594fe8a9-2560-4b43-a04d-ef54aa29617e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e16aa393-485a-4786-814b-9d85b1049bf6 tempest-CreateVolumesFromImageTest-479949580 None] Created volume successfully. Nov 05 16:24:39 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f 1073741824" returned: 0 in 0.411s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:39 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f Nov 05 16:24:39 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:39 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.164s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901264859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bfe92c-91b3-4dc6-a18f-b911dffe8d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:38Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Creating volume b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:39 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:39 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 1073741824 Nov 05 16:24:39 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0851d1b5-71fc-45a4-a18e-50c1b054202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f8c4ca-83cd-491e-b069-4e306025611f', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8025f1-165e-422f-a13d-24cb34532df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Volume volume-12f8c4ca-83cd-491e-b069-4e306025611f (12f8c4ca-83cd-491e-b069-4e306025611f): created successfully Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8025f1-165e-422f-a13d-24cb34532df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (d9f9094b-86b4-4789-b2e9-bdb5fb58af13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f3da2cb3-c7ea-445f-8fa9-a88e9f444750 tempest-CreateVolumesFromImageTest-479949580 None] Created volume successfully. Nov 05 16:24:40 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 1073741824" returned: 0 in 0.411s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:40 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 Nov 05 16:24:40 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:40 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288721076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c2bfde-ae1d-4546-92ad-359d8066844d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94661a9e44076879cb1dd9e140157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:39Z,use_quota=True,user_id='55874532c3d84ff78cefe6258316479a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Creating volume c3c2bfde-ae1d-4546-92ad-359d8066844d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:40 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c02e4d4-6933-4e93-a3d1-5f5d4c7c2e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:40 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d 1073741824 Nov 05 16:24:40 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276e2620-be58-40e4-8727-c3999086e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:40 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Volume volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 (b6bfe92c-91b3-4dc6-a18f-b911dffe8d70): created successfully Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276e2620-be58-40e4-8727-c3999086e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (f9da814d-c537-462b-a721-1b20efedd16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:40 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0e3bb7a0-114a-4480-bd08-6a0a4c29b831 tempest-CreateVolumesFromImageTest-479949580 None] Created volume successfully. Nov 05 16:24:40 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d 1073741824" returned: 0 in 0.397s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:40 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d Nov 05 16:24:40 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:40 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e6ac7a-19d6-4833-ae5b-20db271eca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c2bfde-ae1d-4546-92ad-359d8066844d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3566191-f3da-40b6-bd3f-d1d670004d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:41 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Volume volume-c3c2bfde-ae1d-4546-92ad-359d8066844d (c3c2bfde-ae1d-4546-92ad-359d8066844d): created successfully Nov 05 16:24:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3566191-f3da-40b6-bd3f-d1d670004d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Flow 'volume_create_manager' (0b46352c-d6c4-4f53-8f2b-bd7228807475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:41 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-90f2d08e-2e14-41f1-aa81-7ea1d6ae8404 tempest-CreateVolumesFromImageTest-479949580 None] Created volume successfully. Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-c3c2bfde-ae1d-4546-92ad-359d8066844d-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-c3c2bfde-ae1d-4546-92ad-359d8066844d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-quobyte-c3c2bfde-ae1d-4546-92ad-359d8066844d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-c3c2bfde-ae1d-4546-92ad-359d8066844d" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d65ffc8-22ff-4d5a-b3c9-529d1ea235a8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:42 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d Nov 05 16:24:42 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:42 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d" returned: 0 in 0.352s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:42 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d Nov 05 16:24:42 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:42 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c3c2bfde-ae1d-4546-92ad-359d8066844d" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-c3c2bfde-ae1d-4546-92ad-359d8066844d" released by "delete_volume" :: held 0.644s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Created reservations ['50cc4757-6e6b-4bd3-a72f-d426d73a21b5', '4ecf9376-fe0a-4fee-8c2b-a9128e02bb06', '436c41f6-e294-4478-ba08-e60886b789ab', '51c79481-e675-42e9-ab7c-bb5ac0ef4ed1'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:42 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:42 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:43 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Deleted volume successfully. Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-109eab09-1dcd-494f-a940-cb32a5822f6a tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-c3c2bfde-ae1d-4546-92ad-359d8066844d-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-quobyte-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70" acquired by "delete_volume" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e002a969-e04f-4880-97e2-cc2b2405cb62]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:43 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 Nov 05 16:24:43 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:43 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:43 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70 Nov 05 16:24:43 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:43 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70" released by "delete_volume" :: held 0.635s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:43 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Created reservations ['07b13881-32d4-429f-bdb0-6aebba2e81e0', '392f63c7-1fc3-4134-88ff-b2388c26053f', '1e81ab56-74d8-4078-a69b-80cefae34916', '9662653b-b8d0-41b5-b0f1-803580849e4c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:44 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:44 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:44 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:44 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Deleted volume successfully. Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-d129beaf-762c-4757-a40b-9a293100739f tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-b6bfe92c-91b3-4dc6-a18f-b911dffe8d70-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-12f8c4ca-83cd-491e-b069-4e306025611f-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-12f8c4ca-83cd-491e-b069-4e306025611f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-quobyte-12f8c4ca-83cd-491e-b069-4e306025611f" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-12f8c4ca-83cd-491e-b069-4e306025611f" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0380b8-69e8-4a2d-b158-6bd9c2fd7c4b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:44 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f Nov 05 16:24:44 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:44 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f" returned: 0 in 0.366s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:44 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f Nov 05 16:24:44 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:45 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-12f8c4ca-83cd-491e-b069-4e306025611f" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-12f8c4ca-83cd-491e-b069-4e306025611f" released by "delete_volume" :: held 0.650s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Created reservations ['3655eec1-9516-45ae-9c05-8e3255b1563f', 'bf73415e-0806-42ee-82df-7f1a22d0ee94', 'eff8a64c-1149-4bba-95da-6d650dc6c876', 'c50acc6d-20ec-4ec7-aae8-0b3675e8c2f1'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:45 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:45 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:45 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Deleted volume successfully. Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-56de4caf-9623-404e-9d61-98f1d89b95fb tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-12f8c4ca-83cd-491e-b069-4e306025611f-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-quobyte-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[80060f06-6f08-4b73-9e9b-c0c98cdfe078]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:45 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 Nov 05 16:24:45 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:46 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289" returned: 0 in 0.352s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:46 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289 Nov 05 16:24:46 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:46 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289" released by "delete_volume" :: held 0.630s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Created reservations ['b051fe0d-109b-48ab-badc-8688bf51f67c', 'ae41e027-fd8a-4e3a-a69e-6df36e9284ac', '97e5abba-fddd-484d-a98e-ed725d4790b9', 'c219f2a3-b88d-4825-b2f2-f1ce623124a3'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:46 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:46 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:46 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.239s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Deleted volume successfully. Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a12b0bbf-a8ef-4fb3-a0a6-45e06cb09daf tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-07e36b4f-0e96-4dfb-8076-b0e5a8ce0289-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-ea3199f0-a088-4098-8a19-1507b0392f26-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-ea3199f0-a088-4098-8a19-1507b0392f26-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "cinder-quobyte-ea3199f0-a088-4098-8a19-1507b0392f26" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-ea3199f0-a088-4098-8a19-1507b0392f26" acquired by "delete_volume" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3364741c-7727-43df-9bf8-6a2904b63c3a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:46 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 Nov 05 16:24:46 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:47 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:47 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26 Nov 05 16:24:47 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:47 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ea3199f0-a088-4098-8a19-1507b0392f26" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-quobyte-ea3199f0-a088-4098-8a19-1507b0392f26" released by "delete_volume" :: held 0.631s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Created reservations ['827963d8-4986-4469-8349-823264c810a1', '28ad3067-56ab-46d9-8222-d4a1c6739536', 'e60cbb40-4030-48f4-af3d-e68dbda7e8a2', 'ef00b8f3-b912-4725-8777-caecd78d9905'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:47 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:47 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:47 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.240s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Deleted volume successfully. Nov 05 16:24:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50382f74-ed56-406a-91b6-34004e14ae64 tempest-CreateVolumesFromImageTest-479949580 None] Lock "cinder-ea3199f0-a088-4098-8a19-1507b0392f26-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:50 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:50 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:50 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:24:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (06e1e534-35b2-4405-899d-758232afada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e04448-2632-4add-bbcd-f68e484a0a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e04448-2632-4add-bbcd-f68e484a0a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096761947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c842eaa-539f-4e51-8df8-5d46496fcfd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:51Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62658f71-6316-456c-a613-5ead200919f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62658f71-6316-456c-a613-5ead200919f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e140a57f-67b2-4dc2-b742-d67acffc17e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e140a57f-67b2-4dc2-b742-d67acffc17e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c842eaa-539f-4e51-8df8-5d46496fcfd0', 'volume_name': 'volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d37992-db96-4757-9bf8-6ddcad214b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d37992-db96-4757-9bf8-6ddcad214b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e75c47-3a78-4f1b-a275-ea2f42b1bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:51 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Volume 8c842eaa-539f-4e51-8df8-5d46496fcfd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0', 'volume_size': 1} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096761947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c842eaa-539f-4e51-8df8-5d46496fcfd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:51Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Creating volume 8c842eaa-539f-4e51-8df8-5d46496fcfd0 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:51 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:51 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 1073741824 Nov 05 16:24:51 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:51 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 1073741824" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:51 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 Nov 05 16:24:51 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:51 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e75c47-3a78-4f1b-a275-ea2f42b1bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c17352-49a5-48f3-83ed-cb2eccdf3399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:51 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Volume volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 (8c842eaa-539f-4e51-8df8-5d46496fcfd0): created successfully Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c17352-49a5-48f3-83ed-cb2eccdf3399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:51 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (06e1e534-35b2-4405-899d-758232afada8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fbe0238d-8ca6-40f0-b378-2de06f318d30 tempest-ProjectReaderTests-1932246625 None] Created volume successfully. Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-8c842eaa-539f-4e51-8df8-5d46496fcfd0-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Lock "cinder-8c842eaa-539f-4e51-8df8-5d46496fcfd0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-quobyte-8c842eaa-539f-4e51-8df8-5d46496fcfd0" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-8c842eaa-539f-4e51-8df8-5d46496fcfd0" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085d67a-32e3-4308-85cd-a14e1dbae3fb]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:52 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 Nov 05 16:24:52 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:52 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0" returned: 0 in 0.349s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:52 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0 Nov 05 16:24:52 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:52 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8c842eaa-539f-4e51-8df8-5d46496fcfd0" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-8c842eaa-539f-4e51-8df8-5d46496fcfd0" released by "delete_volume" :: held 0.630s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Created reservations ['71717166-dd16-47b9-9dae-7305f9cec8aa', '5d928e8e-ed02-497b-ba4f-dceee12b3478', '87798aad-4e72-4371-9319-49645c7d9a74', '1c0f7775-0bf9-462d-bbb2-2907186a9493'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:53 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:53 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:53 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Deleted volume successfully. Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-fa82af42-5510-42d8-a8b7-fb079cb0b78c tempest-ProjectReaderTests-1932246625 None] Lock "cinder-8c842eaa-539f-4e51-8df8-5d46496fcfd0-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (af35b863-669b-4fab-95fa-fe9d5b0edf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d4d44c-9078-4c76-9a24-c9e1f035a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d4d44c-9078-4c76-9a24-c9e1f035a09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078371044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12a079b-06e9-4e06-b59b-470da5b0a444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:54Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0987a22a-b456-46ff-8d4e-924f135d67cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0987a22a-b456-46ff-8d4e-924f135d67cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7e61ca-aa54-42ad-8101-e7b860861774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7e61ca-aa54-42ad-8101-e7b860861774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12a079b-06e9-4e06-b59b-470da5b0a444', 'volume_name': 'volume-a12a079b-06e9-4e06-b59b-470da5b0a444', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8865fe-e044-41e4-8b82-9f6108cb10f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8865fe-e044-41e4-8b82-9f6108cb10f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22828a23-e7fe-4d7f-8a95-6fafed29a2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:53 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Volume a12a079b-06e9-4e06-b59b-470da5b0a444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12a079b-06e9-4e06-b59b-470da5b0a444', 'volume_size': 1} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078371044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12a079b-06e9-4e06-b59b-470da5b0a444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:54Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Creating volume a12a079b-06e9-4e06-b59b-470da5b0a444 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:53 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:53 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 1073741824 Nov 05 16:24:53 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:54 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 1073741824" returned: 0 in 0.400s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:54 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 Nov 05 16:24:54 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:54 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22828a23-e7fe-4d7f-8a95-6fafed29a2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12a079b-06e9-4e06-b59b-470da5b0a444', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd77f63-31a1-41c5-951c-f0f9eb7feaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Volume volume-a12a079b-06e9-4e06-b59b-470da5b0a444 (a12a079b-06e9-4e06-b59b-470da5b0a444): created successfully Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd77f63-31a1-41c5-951c-f0f9eb7feaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (af35b863-669b-4fab-95fa-fe9d5b0edf1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-100d0802-27c1-4a77-8250-945f888ce7d4 tempest-ProjectReaderTests-1932246625 None] Created volume successfully. Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-a12a079b-06e9-4e06-b59b-470da5b0a444-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Lock "cinder-a12a079b-06e9-4e06-b59b-470da5b0a444-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-quobyte-a12a079b-06e9-4e06-b59b-470da5b0a444" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-a12a079b-06e9-4e06-b59b-470da5b0a444" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3408b907-3efa-4966-b609-508b2603714a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:54 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 Nov 05 16:24:54 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:55 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444" returned: 0 in 0.349s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:55 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444 Nov 05 16:24:55 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:55 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-a12a079b-06e9-4e06-b59b-470da5b0a444" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-a12a079b-06e9-4e06-b59b-470da5b0a444" released by "delete_volume" :: held 0.634s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Created reservations ['09591c48-8a9b-47fb-a750-ce688a2ceb35', '063aa010-3a0e-483f-be4a-f0fb97edb135', '89c7a0fc-b6f0-41ae-b5c9-a3131ff76528', '4d9fc0d8-2e4b-4c49-923f-8f3fc6b055d7'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:55 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:55 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:55 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.236s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Deleted volume successfully. Nov 05 16:24:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6c6e08a2-221c-453d-84e8-35d39142cebe tempest-ProjectReaderTests-1932246625 None] Lock "cinder-a12a079b-06e9-4e06-b59b-470da5b0a444-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (3dcfa680-58f2-4a83-8acc-d9e7e3012681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f1865-8e99-463e-b424-53477dff7f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f1865-8e99-463e-b424-53477dff7f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147416896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:56Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74773334-1602-4304-ab78-34e175b0fa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74773334-1602-4304-ab78-34e175b0fa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fca2c24-f4ec-474e-9c19-4585f9033f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fca2c24-f4ec-474e-9c19-4585f9033f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43', 'volume_name': 'volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff9042c-db46-4bcc-bc89-6048eebbddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff9042c-db46-4bcc-bc89-6048eebbddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba2ef87-272b-4320-b758-41d231b05b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Volume 4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43', 'volume_size': 1} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147416896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:56Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Creating volume 4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:56 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:56 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 1073741824 Nov 05 16:24:56 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:56 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 1073741824" returned: 0 in 0.400s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:56 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 Nov 05 16:24:56 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:57 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba2ef87-272b-4320-b758-41d231b05b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f378a9-d540-470c-85e8-ab10961b1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:57 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Volume volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 (4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43): created successfully Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f378a9-d540-470c-85e8-ab10961b1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (3dcfa680-58f2-4a83-8acc-d9e7e3012681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-113dc3d7-d560-43d3-a22a-e6f1ae54d9df tempest-ProjectReaderTests-1932246625 None] Created volume successfully. Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Lock "cinder-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-quobyte-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[57363672-ba65-4022-b3f4-aee94b17b428]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:57 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 Nov 05 16:24:57 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:57 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43" returned: 0 in 0.360s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:57 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43 Nov 05 16:24:57 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:58 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43" released by "delete_volume" :: held 0.650s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Created reservations ['091b1b49-5a6d-4874-93ff-f13fec69c1c9', 'f4f5fed0-d0e4-4195-bd38-bdd7945d9090', '7cec0c53-6bd4-4526-b41a-324577ef342d', 'd82c9cda-e8a2-4b04-8cc8-1d5cbe7e2609'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:58 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:24:58 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:58 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.249s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:24:58 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Deleted volume successfully. Nov 05 16:24:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-837b6a20-fbf3-40e6-b9e6-061a790251c9 tempest-ProjectReaderTests-1932246625 None] Lock "cinder-4ac8f3a8-2f9c-4cd1-9931-1b43820dfc43-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (888707fd-102d-4596-a412-84f5cd7cf18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead8887a-d988-42f8-84cd-8f6227ebd920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead8887a-d988-42f8-84cd-8f6227ebd920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524703906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc3979d-45db-480a-a7a3-03c3b2fa26da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:59Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7adac66-5b03-47ab-bee2-5e89e62c025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7adac66-5b03-47ab-bee2-5e89e62c025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc59ec-69b8-4575-a6a6-5a0b7f097d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc59ec-69b8-4575-a6a6-5a0b7f097d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc3979d-45db-480a-a7a3-03c3b2fa26da', 'volume_name': 'volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411a7466-b40a-4133-b965-0063ab7bb981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411a7466-b40a-4133-b965-0063ab7bb981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21714459-f558-4899-bb1c-467115c03241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:59 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Volume 9bc3979d-45db-480a-a7a3-03c3b2fa26da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da', 'volume_size': 1} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524703906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc3979d-45db-480a-a7a3-03c3b2fa26da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea4460d4ff0c46c0911894150c4a49da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:24:59Z,use_quota=True,user_id='477f7bb1d0004a0b866151635c4e1d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Creating volume 9bc3979d-45db-480a-a7a3-03c3b2fa26da {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:24:59 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:59 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da 1073741824 Nov 05 16:24:59 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:59 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da 1073741824" returned: 0 in 0.427s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:24:59 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da Nov 05 16:24:59 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:24:59 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da" returned: 0 in 0.268s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21714459-f558-4899-bb1c-467115c03241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c0e3da-8b42-4945-a536-2c29ecc90bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:24:59 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Volume volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da (9bc3979d-45db-480a-a7a3-03c3b2fa26da): created successfully Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c0e3da-8b42-4945-a536-2c29ecc90bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:24:59 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Flow 'volume_create_manager' (888707fd-102d-4596-a412-84f5cd7cf18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:24:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8822970b-5019-4c6b-8070-b057fa8c19f5 tempest-ProjectReaderTests-1932246625 None] Created volume successfully. Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-9bc3979d-45db-480a-a7a3-03c3b2fa26da-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Lock "cinder-9bc3979d-45db-480a-a7a3-03c3b2fa26da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Acquiring lock "cinder-quobyte-9bc3979d-45db-480a-a7a3-03c3b2fa26da" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-9bc3979d-45db-480a-a7a3-03c3b2fa26da" acquired by "delete_volume" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6459aa-613b-4801-8816-e84767239683]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:00 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da Nov 05 16:25:00 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:00 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da" returned: 0 in 0.363s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:00 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da Nov 05 16:25:00 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:00 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9bc3979d-45db-480a-a7a3-03c3b2fa26da" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Lock "cinder-quobyte-9bc3979d-45db-480a-a7a3-03c3b2fa26da" released by "delete_volume" :: held 0.646s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Created reservations ['dc88fb38-d789-42b0-9049-2d0ef2a6d85a', 'c29331b5-73be-45a0-9df6-17519681f1f0', 'a7d35db8-ff4e-44ce-bcdf-e8e1cc7f8bf4', 'a80338e6-ea12-4431-a7a8-c66f23cf7d0e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:00 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:00 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:01 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:01 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Deleted volume successfully. Nov 05 16:25:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e334c254-70dd-4dc0-bfa8-260c16ec77ba tempest-ProjectReaderTests-1932246625 None] Lock "cinder-9bc3979d-45db-480a-a7a3-03c3b2fa26da-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:10 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=70,cinder:UPDATE=103,cinder:DELETE=7,cinder:INSERT=22 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:25:11 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=57,cinder:UPDATE=96,cinder:INSERT=23,cinder:DELETE=11 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (ee98e683-8ff8-4e2b-a20f-028220b9c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fac9624-d531-476a-a5fc-d25810891e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fac9624-d531-476a-a5fc-d25810891e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148908103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385eb78d-fcfe-4343-bfc6-bf5e87c16fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:13Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605987f5-329b-460e-8f2e-a67e3c86e52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605987f5-329b-460e-8f2e-a67e3c86e52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27840bf8-1e95-4647-adee-81679fddf36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27840bf8-1e95-4647-adee-81679fddf36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385eb78d-fcfe-4343-bfc6-bf5e87c16fb2', 'volume_name': 'volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b733c3-f86b-4c9a-a4d5-27cab25ada22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b733c3-f86b-4c9a-a4d5-27cab25ada22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2ea117-b28a-4923-b0d4-8e91f02dee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume 385eb78d-fcfe-4343-bfc6-bf5e87c16fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2', 'volume_size': 1} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148908103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385eb78d-fcfe-4343-bfc6-bf5e87c16fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:13Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Creating volume 385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:13 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (334c9763-c295-4601-b1be-89922883b508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:13 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 1073741824 Nov 05 16:25:13 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69503c82-0278-4941-9b2f-b250b2a0176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69503c82-0278-4941-9b2f-b250b2a0176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254772651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:13Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7538fb2-ff57-42a0-8899-8eae1272fba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7538fb2-ff57-42a0-8899-8eae1272fba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5318e021-832e-4bc0-8226-061717586c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5318e021-832e-4bc0-8226-061717586c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b', 'volume_name': 'volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a68831-c6d9-49c2-850b-4d2ce7039707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a68831-c6d9-49c2-850b-4d2ce7039707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ec53f0-f7c0-45e9-8a28-92b37e111ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume 3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b', 'volume_size': 1} Nov 05 16:25:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Flow 'volume_create_manager' (1070c863-d503-4065-afe8-bff318bdb1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976338b4-8a3e-4114-81a9-af5cd0247ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976338b4-8a3e-4114-81a9-af5cd0247ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-635466071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7a3c1e-d934-4fbf-b1fb-eb442178b251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4009f791f3fb43d0b68ccebd1856d09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:14Z,use_quota=True,user_id='7365bdbc498948deb448de404feed625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37862b8d-c5ca-4086-b001-7005c78c81a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37862b8d-c5ca-4086-b001-7005c78c81a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db226b3-00ae-4c38-8502-6f1387c5f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db226b3-00ae-4c38-8502-6f1387c5f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7a3c1e-d934-4fbf-b1fb-eb442178b251', 'volume_name': 'volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f11ffa-6361-4e3b-8b6e-06c8422320cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f11ffa-6361-4e3b-8b6e-06c8422320cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca9ccc8-8fab-4e71-a071-9e15cf5c41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:14 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Volume 9b7a3c1e-d934-4fbf-b1fb-eb442178b251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251', 'volume_size': 1} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:14 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 1073741824" returned: 0 in 0.556s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:14 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 Nov 05 16:25:14 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:14 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2" returned: 0 in 0.260s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254772651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:13Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Creating volume 3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:14 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:14 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b 1073741824 Nov 05 16:25:14 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2ea117-b28a-4923-b0d4-8e91f02dee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5226ea99-a0cf-4fac-bf2f-be4683c486fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:14 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 (385eb78d-fcfe-4343-bfc6-bf5e87c16fb2): created successfully Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5226ea99-a0cf-4fac-bf2f-be4683c486fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (ee98e683-8ff8-4e2b-a20f-028220b9c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-02ff023a-ca0b-442c-b2c4-ce6c3131a3b2 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created volume successfully. Nov 05 16:25:14 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b 1073741824" returned: 0 in 0.447s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:15 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b Nov 05 16:25:15 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:15 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.121s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-635466071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7a3c1e-d934-4fbf-b1fb-eb442178b251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4009f791f3fb43d0b68ccebd1856d09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:14Z,use_quota=True,user_id='7365bdbc498948deb448de404feed625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Creating volume 9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:15 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ec53f0-f7c0-45e9-8a28-92b37e111ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ef1cda-7fa0-4be4-b14c-8be3d93c863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:15 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 1073741824 Nov 05 16:25:15 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b (3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b): created successfully Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ef1cda-7fa0-4be4-b14c-8be3d93c863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (334c9763-c295-4601-b1be-89922883b508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b1af3dea-6fd7-4ece-ab63-452696bfdf45 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created volume successfully. Nov 05 16:25:15 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 1073741824" returned: 0 in 0.588s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:15 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 Nov 05 16:25:15 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:15 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (b8807096-b01c-4d85-b7b1-d0a6dbf78ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27f61fb-6258-4554-8282-42e54b7fe046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27f61fb-6258-4554-8282-42e54b7fe046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685683784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03a8d1f-6742-48ff-8b66-76de67814e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:16Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ae7768-cdeb-4351-9080-1cedab4dcb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ae7768-cdeb-4351-9080-1cedab4dcb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b50e0dc-8c53-482d-a366-c73d6d676cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b50e0dc-8c53-482d-a366-c73d6d676cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03a8d1f-6742-48ff-8b66-76de67814e53', 'volume_name': 'volume-f03a8d1f-6742-48ff-8b66-76de67814e53', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f0aa4c-bb5b-4c9d-ae75-3c8b560748ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f0aa4c-bb5b-4c9d-ae75-3c8b560748ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92aa96b-6fd4-4920-acd5-cb9d0bd85b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume f03a8d1f-6742-48ff-8b66-76de67814e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03a8d1f-6742-48ff-8b66-76de67814e53', 'volume_size': 1} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:16 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" returned: 0 in 0.377s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685683784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03a8d1f-6742-48ff-8b66-76de67814e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:16Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Creating volume f03a8d1f-6742-48ff-8b66-76de67814e53 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:16 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:16 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 1073741824 Nov 05 16:25:16 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca9ccc8-8fab-4e71-a071-9e15cf5c41a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d087795-51d8-49a0-8571-d93ce8b1927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (fcecbad4-bfbd-4d1b-935c-4c597a30c99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc2c1c8-ac8e-44c8-a049-35900614eede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Volume volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 (9b7a3c1e-d934-4fbf-b1fb-eb442178b251): created successfully Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d087795-51d8-49a0-8571-d93ce8b1927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Flow 'volume_create_manager' (1070c863-d503-4065-afe8-bff318bdb1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5af46802-5c26-46c8-9b3f-c55674a9523c tempest-VolumeDependencyTests-758635139 None] Created volume successfully. Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc2c1c8-ac8e-44c8-a049-35900614eede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645645860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0224aa1f-b4e9-4378-b772-859c571f102a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:16Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f6f98c-1ba6-4498-913f-1e344da075b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f6f98c-1ba6-4498-913f-1e344da075b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de197ff-35a8-4142-9893-ebd9a73ee6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de197ff-35a8-4142-9893-ebd9a73ee6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0224aa1f-b4e9-4378-b772-859c571f102a', 'volume_name': 'volume-0224aa1f-b4e9-4378-b772-859c571f102a', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe83cd5-7e5e-4b25-9798-50a279433a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe83cd5-7e5e-4b25-9798-50a279433a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b464d1-0379-4cea-9eb7-1e5b024b25eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume 0224aa1f-b4e9-4378-b772-859c571f102a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0224aa1f-b4e9-4378-b772-859c571f102a', 'volume_size': 1} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (94dfff5c-66dc-4b30-9f39-7620e9e9debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415dc30f-4a5f-417c-be56-8f3c3db78f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415dc30f-4a5f-417c-be56-8f3c3db78f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308115863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d136187e-286c-47ba-b18a-524e6e702926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:17Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f916a86-0509-4f63-aff6-684e7fe98550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f916a86-0509-4f63-aff6-684e7fe98550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c1381e-ce4d-4fbc-852c-89e530fd8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c1381e-ce4d-4fbc-852c-89e530fd8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd136187e-286c-47ba-b18a-524e6e702926', 'volume_name': 'volume-d136187e-286c-47ba-b18a-524e6e702926', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb116f6-2314-4aba-a6c1-ca7598d57ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb116f6-2314-4aba-a6c1-ca7598d57ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1acfd3-f26a-4aff-9be1-915dcc62704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:16 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume d136187e-286c-47ba-b18a-524e6e702926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d136187e-286c-47ba-b18a-524e6e702926', 'volume_size': 1} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:16 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 1073741824" returned: 0 in 0.660s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:17 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 Nov 05 16:25:17 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:17 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (be7242fb-4b05-418b-b061-2ba743fd92c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f3d193-d8ce-428a-b241-dd1de8e5a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53" returned: 0 in 0.343s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.787s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645645860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0224aa1f-b4e9-4378-b772-859c571f102a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:16Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Creating volume 0224aa1f-b4e9-4378-b772-859c571f102a {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:17 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f3d193-d8ce-428a-b241-dd1de8e5a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582004711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffa2912-db34-4428-8288-c0c3ba7eba64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:17Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a849f347-6865-4054-b33c-e2db6fd78ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a849f347-6865-4054-b33c-e2db6fd78ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:17 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a 1073741824 Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6ae2b1-8f04-4567-a6c2-a5a919988b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6ae2b1-8f04-4567-a6c2-a5a919988b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffa2912-db34-4428-8288-c0c3ba7eba64', 'volume_name': 'volume-4ffa2912-db34-4428-8288-c0c3ba7eba64', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa3155f-ffcd-40d7-a1f8-131f030c9344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa3155f-ffcd-40d7-a1f8-131f030c9344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea51d82-2ec6-4bfc-942a-960329644dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume 4ffa2912-db34-4428-8288-c0c3ba7eba64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffa2912-db34-4428-8288-c0c3ba7eba64', 'volume_size': 1} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92aa96b-6fd4-4920-acd5-cb9d0bd85b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03a8d1f-6742-48ff-8b66-76de67814e53', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c867accd-157a-41fd-a888-322b9a16b43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume volume-f03a8d1f-6742-48ff-8b66-76de67814e53 (f03a8d1f-6742-48ff-8b66-76de67814e53): created successfully Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c867accd-157a-41fd-a888-322b9a16b43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (b8807096-b01c-4d85-b7b1-d0a6dbf78ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bcb5ee3c-decb-4add-98a3-a44fd13e128c tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created volume successfully. Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (8d453367-6b74-42c4-b61b-36790282b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afcad8d-5238-408e-965e-5c5d62ee3fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afcad8d-5238-408e-965e-5c5d62ee3fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435559636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ded954d-9bda-42d7-8d4f-7972ad9944d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:18Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92056cf0-74d6-4680-88e9-e1d3384aed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92056cf0-74d6-4680-88e9-e1d3384aed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26e12f9-e141-4ccc-93b7-b03f82ef0cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26e12f9-e141-4ccc-93b7-b03f82ef0cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ded954d-9bda-42d7-8d4f-7972ad9944d0', 'volume_name': 'volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac00e09f-7fe7-444c-a161-9da212ab7bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac00e09f-7fe7-444c-a161-9da212ab7bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b56b2c8-2e6e-41e9-9237-5645f211dc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume 6ded954d-9bda-42d7-8d4f-7972ad9944d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0', 'volume_size': 1} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a 1073741824" returned: 0 in 0.649s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:18 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a Nov 05 16:25:18 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Flow 'volume_create_manager' (dcace541-b3e3-4f18-a02b-0f8eea400547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59e25de-e582-4b40-bd28-cada45cbbbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59e25de-e582-4b40-bd28-cada45cbbbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e48018-f5d4-4e1c-9756-5c5d5ade9326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a027f6a86484e71a3052eb6c6e364e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:18Z,use_quota=True,user_id='9977f298b4484a72b0ba01244119a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c981712-cd10-4b72-93f2-faee85c77929),volume_type_id=8c981712-cd10-4b72-93f2-faee85c77929)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd29003-10bc-42b8-b9ce-02b137f3152f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd29003-10bc-42b8-b9ce-02b137f3152f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabbd67f-5d72-47d9-8421-2c1c0c99f786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:25:18 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a" returned: 0 in 0.271s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308115863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d136187e-286c-47ba-b18a-524e6e702926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:17Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Creating volume d136187e-286c-47ba-b18a-524e6e702926 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:18 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b464d1-0379-4cea-9eb7-1e5b024b25eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0224aa1f-b4e9-4378-b772-859c571f102a', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 1073741824 Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48cb9d86-b57e-4baa-a2bf-7d8b4d28c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume volume-0224aa1f-b4e9-4378-b772-859c571f102a (0224aa1f-b4e9-4378-b772-859c571f102a): created successfully Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48cb9d86-b57e-4baa-a2bf-7d8b4d28c874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (fcecbad4-bfbd-4d1b-935c-4c597a30c99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3c96c35a-01d8-4c46-8aa6-905667b3e503 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created volume successfully. Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabbd67f-5d72-47d9-8421-2c1c0c99f786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77e48018-f5d4-4e1c-9756-5c5d5ade9326', 'volume_name': 'volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326', 'volume_size': 1, 'image_id': '54780fb8-1f74-4545-8adb-a68b477f0e9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54780fb8-1f74-4545-8adb-a68b477f0e9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a02938eab3e2aafddaddc79ad736b0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a027f6a86484e71a3052eb6c6e364e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c0abb2aac252e141681687c97403560c18f8cb2e82635ced73422e539851791a2cb725b307eefc9d08b58439b4f44800694ab780026a60fcaa27789f88b479a', 'id': '54780fb8-1f74-4545-8adb-a68b477f0e9a', 'created_at': datetime.datetime(2026, 11, 5, 15, 25, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 25, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54780fb8-1f74-4545-8adb-a68b477f0e9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f53aec-232b-4694-aff2-44fbeead6675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f53aec-232b-4694-aff2-44fbeead6675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23325fa-4dd0-49e0-800f-3e5567917cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Volume 77e48018-f5d4-4e1c-9756-5c5d5ade9326: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326', 'volume_size': 1, 'image_id': '54780fb8-1f74-4545-8adb-a68b477f0e9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54780fb8-1f74-4545-8adb-a68b477f0e9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a02938eab3e2aafddaddc79ad736b0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a027f6a86484e71a3052eb6c6e364e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c0abb2aac252e141681687c97403560c18f8cb2e82635ced73422e539851791a2cb725b307eefc9d08b58439b4f44800694ab780026a60fcaa27789f88b479a', 'id': '54780fb8-1f74-4545-8adb-a68b477f0e9a', 'created_at': datetime.datetime(2026, 11, 5, 15, 25, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 25, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54780fb8-1f74-4545-8adb-a68b477f0e9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Trying to clone 77e48018-f5d4-4e1c-9756-5c5d5ade9326 from image 54780fb8-1f74-4545-8adb-a68b477f0e9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/54780fb8-1f74-4545-8adb-a68b477f0e9a', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:25:18 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Image download 0.00 MB at 0.00 MB/s Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[88566a5a-22d9-4626-aa5d-6a663f453065]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:18 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD Nov 05 16:25:18 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:18 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 1073741824" returned: 0 in 0.472s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:18 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 Nov 05 16:25:18 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:19 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:19 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD Nov 05 16:25:19 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:19 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.234s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1acfd3-f26a-4aff-9be1-915dcc62704e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d136187e-286c-47ba-b18a-524e6e702926', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4695983a-40ea-4aa3-8d15-3a4845386d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Creating offline snapshot 34abae16-c9ec-452d-be4c-0fb51812b1c4 of volume 3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:25:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume volume-d136187e-286c-47ba-b18a-524e6e702926 (d136187e-286c-47ba-b18a-524e6e702926): created successfully Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4695983a-40ea-4aa3-8d15-3a4845386d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (94dfff5c-66dc-4b30-9f39-7620e9e9debe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79189ae6-d262-49d3-8c4c-3189e2785939]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e4e8bf1b-5b17-4371-b968-f611b3de7ad9 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created volume successfully. Nov 05 16:25:19 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b Nov 05 16:25:19 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:19 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Temporary image 54780fb8-1f74-4545-8adb-a68b477f0e9a is fetched for user 9977f298b4484a72b0ba01244119a3b0. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e56bf44-055d-4d65-b2d5-6d51f74e5b86]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:19 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD Nov 05 16:25:19 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:19 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:19 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 1G Nov 05 16:25:19 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:19 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:19 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD Nov 05 16:25:19 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:20 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 1G" returned: 0 in 0.423s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:20 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 Nov 05 16:25:20 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:20 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:20 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4" returned: 0 in 0.300s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:20 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 is being set with open permissions: ugo+rw Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:20 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 Nov 05 16:25:20 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:20 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:20 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.info Nov 05 16:25:20 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:20 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.info" returned: 0 in 0.259s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:20 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.info is being set with open permissions: ugo+rw Nov 05 16:25:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:20 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.info Nov 05 16:25:20 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:21 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.info" returned: 0 in 0.249s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.722s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-582004711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffa2912-db34-4428-8288-c0c3ba7eba64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:17Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Creating volume 4ffa2912-db34-4428-8288-c0c3ba7eba64 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:21 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:21 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 1073741824 Nov 05 16:25:21 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ba4d0e7c-1833-440f-bdb3-9e659fe6cc4a tempest-CreateVolumesFromSnapshotTest-1019201069 None] Create snapshot completed successfully Nov 05 16:25:21 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 1073741824" returned: 0 in 0.426s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:21 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 Nov 05 16:25:21 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:21 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64" returned: 0 in 0.253s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.875s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435559636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ded954d-9bda-42d7-8d4f-7972ad9944d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e78947d2de48afb838dca06ec734f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:18Z,use_quota=True,user_id='138bace6286147b29438255e54d73e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Creating volume 6ded954d-9bda-42d7-8d4f-7972ad9944d0 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:21 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea51d82-2ec6-4bfc-942a-960329644dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffa2912-db34-4428-8288-c0c3ba7eba64', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:21 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 1073741824 Nov 05 16:25:21 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a0ce6c-3a70-407a-bd7d-a21678e0b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:21 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 (4ffa2912-db34-4428-8288-c0c3ba7eba64): created successfully Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a0ce6c-3a70-407a-bd7d-a21678e0b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (be7242fb-4b05-418b-b061-2ba743fd92c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b08226e0-7cca-47dc-9f1c-cc49e2cbbb71 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created volume successfully. Nov 05 16:25:22 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 1073741824" returned: 0 in 0.472s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:22 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 Nov 05 16:25:22 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:22 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0" returned: 0 in 0.271s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.638s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b56b2c8-2e6e-41e9-9237-5645f211dc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3287e8-4da1-4051-ad7a-bd89fe7a385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Creating offline snapshot 1a279c93-4286-4ff3-92cb-961251ebe959 of volume 9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:25:22 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Volume volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 (6ded954d-9bda-42d7-8d4f-7972ad9944d0): created successfully Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3287e8-4da1-4051-ad7a-bd89fe7a385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Flow 'volume_create_manager' (8d453367-6b74-42c4-b61b-36790282b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eeb34e-a78b-4bce-8080-02db4085aef8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:22 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-176887d3-be48-4462-9bcd-3f706816538d tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created volume successfully. Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (fc409422-d5c1-4c6b-aa48-c6abdb6139a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e371f2e9-01fa-4fae-8764-02c23542fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e371f2e9-01fa-4fae-8764-02c23542fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1085401015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8cd95d6-4503-42bc-96da-bccc4d52f4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:23Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376d7c9d-88df-4660-b9d8-4ce553919b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:22 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376d7c9d-88df-4660-b9d8-4ce553919b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:22 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc947d6e-3abf-4600-9cc8-e381e3a87707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc947d6e-3abf-4600-9cc8-e381e3a87707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8cd95d6-4503-42bc-96da-bccc4d52f4b8', 'volume_name': 'volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9c74e2-b821-4227-ac92-5364699611c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9c74e2-b821-4227-ac92-5364699611c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad59fa6-7a5b-4890-b4d3-4121fd426093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:22 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume d8cd95d6-4503-42bc-96da-bccc4d52f4b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8', 'volume_size': 1} Nov 05 16:25:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:23 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" returned: 0 in 0.445s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:23 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 1G Nov 05 16:25:23 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (8db2f3d7-d689-47a3-a9e9-b69805c0c05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ca484d-33c5-4a09-b101-7812e2ba3887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ca484d-33c5-4a09-b101-7812e2ba3887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026409594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fdf24d-6648-44be-b003-f209ca546821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:23Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb9c69-87a3-4427-a72a-e336a42e829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fb9c69-87a3-4427-a72a-e336a42e829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5034f0-a2a6-43f6-9414-684e75c79a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5034f0-a2a6-43f6-9414-684e75c79a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90fdf24d-6648-44be-b003-f209ca546821', 'volume_name': 'volume-90fdf24d-6648-44be-b003-f209ca546821', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0568bc07-4092-4201-a5dc-bc20f24edf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0568bc07-4092-4201-a5dc-bc20f24edf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ffc2b2-9ed9-4026-a0c8-e0778265a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume 90fdf24d-6648-44be-b003-f209ca546821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90fdf24d-6648-44be-b003-f209ca546821', 'volume_size': 1} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-6ded954d-9bda-42d7-8d4f-7972ad9944d0-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-6ded954d-9bda-42d7-8d4f-7972ad9944d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-quobyte-6ded954d-9bda-42d7-8d4f-7972ad9944d0" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-6ded954d-9bda-42d7-8d4f-7972ad9944d0" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[807008f1-fd7c-4fbe-b4aa-373cdc989cf2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (2acebc1a-6d7b-4bdc-86db-842b67e33b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c6acae-dc19-4cae-8ba1-e4b5612980d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c6acae-dc19-4cae-8ba1-e4b5612980d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-39330310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff55e4d-9250-49a3-85e8-0cee1d4b56f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:24Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ed84b2-9a95-4a66-861d-33d2bd4dde54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 Nov 05 16:25:23 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ed84b2-9a95-4a66-861d-33d2bd4dde54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ceb296-c26c-4958-ac0f-f64f3ba97694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ceb296-c26c-4958-ac0f-f64f3ba97694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff55e4d-9250-49a3-85e8-0cee1d4b56f5', 'volume_name': 'volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c7a971-145d-461f-8a62-2034c16abe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c7a971-145d-461f-8a62-2034c16abe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba95f0d-ced0-499f-a712-653f0505b86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:23 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume dff55e4d-9250-49a3-85e8-0cee1d4b56f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5', 'volume_size': 1} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 1G" returned: 0 in 0.626s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:23 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 Nov 05 16:25:23 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (66d42808-b237-47c1-b3a2-31414bb5528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d479b9-15dc-4b17-a1e4-97660bd4d8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d479b9-15dc-4b17-a1e4-97660bd4d8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683210043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bdae85-933a-463e-85ef-f0342d8572e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:24Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deaaea93-0849-427c-8054-c5e73e5fed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deaaea93-0849-427c-8054-c5e73e5fed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abdc1e6-c89b-4480-95b1-158fc77701a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abdc1e6-c89b-4480-95b1-158fc77701a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17bdae85-933a-463e-85ef-f0342d8572e4', 'volume_name': 'volume-17bdae85-933a-463e-85ef-f0342d8572e4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb52b5a-31fc-4b0f-812f-4fc0c49ae8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb52b5a-31fc-4b0f-812f-4fc0c49ae8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388bf2e-472d-4d42-a8f8-dca0a9b15548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume 17bdae85-933a-463e-85ef-f0342d8572e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17bdae85-933a-463e-85ef-f0342d8572e4', 'volume_size': 1} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:24 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:24 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0" returned: 0 in 0.539s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959" returned: 0 in 0.345s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:24 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 is being set with open permissions: ugo+rw Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:24 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0 Nov 05 16:25:24 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:24 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 Nov 05 16:25:24 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (a9748174-4c50-472a-8ddf-216f96531eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e13d76-043e-4ec5-a4ce-898fc2abf9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e13d76-043e-4ec5-a4ce-898fc2abf9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1418210665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a1c254-cf0c-4349-b77e-86fbe41ef1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:24Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932097b6-7c4d-426f-8787-1bf93525460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932097b6-7c4d-426f-8787-1bf93525460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19515e6-91ac-498b-912f-c5788c422da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19515e6-91ac-498b-912f-c5788c422da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a1c254-cf0c-4349-b77e-86fbe41ef1af', 'volume_name': 'volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf229c2-450f-4945-9c14-cbe6f936532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf229c2-450f-4945-9c14-cbe6f936532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da7e28d-31bd-4c1c-adda-97e2b2884707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:24 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume 14a1c254-cf0c-4349-b77e-86fbe41ef1af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af', 'volume_size': 1} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6ded954d-9bda-42d7-8d4f-7972ad9944d0" returned: 0 in 0.331s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959" returned: 0 in 0.315s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-6ded954d-9bda-42d7-8d4f-7972ad9944d0" released by "delete_volume" :: held 0.933s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:24 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.info Nov 05 16:25:24 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created reservations ['6e58357a-a6e6-4bb5-a261-93ba6658aa34', '05832a0e-4b9b-49af-9703-e62422ac93bb', '9a7d1d95-9f1c-4a3f-af94-616545199f3e', 'eb91e00b-3a88-480f-bd43-1585b80c273a'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:24 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:24 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:24 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.info" returned: 0 in 0.269s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:24 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.info is being set with open permissions: ugo+rw Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:24 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.info Nov 05 16:25:24 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:24 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.273s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:24 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:24 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Deleted volume successfully. Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-65304482-6a8a-46fa-a602-1e6cb12c528a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-6ded954d-9bda-42d7-8d4f-7972ad9944d0-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:25 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.info" returned: 0 in 0.278s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.996s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e48018-f5d4-4e1c-9756-5c5d5ade9326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a027f6a86484e71a3052eb6c6e364e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:18Z,use_quota=True,user_id='9977f298b4484a72b0ba01244119a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c981712-cd10-4b72-93f2-faee85c77929),volume_type_id=8c981712-cd10-4b72-93f2-faee85c77929)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Creating volume 77e48018-f5d4-4e1c-9756-5c5d5ade9326 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:25 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:25 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 1073741824 Nov 05 16:25:25 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-071100ad-69f5-4131-ab0f-b2198fe8fdc4 tempest-VolumeDependencyTests-758635139 None] Create snapshot completed successfully Nov 05 16:25:25 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 1073741824" returned: 0 in 0.413s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:25 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 Nov 05 16:25:25 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-4ffa2912-db34-4428-8288-c0c3ba7eba64-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-4ffa2912-db34-4428-8288-c0c3ba7eba64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-quobyte-4ffa2912-db34-4428-8288-c0c3ba7eba64" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-4ffa2912-db34-4428-8288-c0c3ba7eba64" acquired by "delete_volume" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:25 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[108aac6f-81ca-4ab5-a263-4027f08754fa]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.920s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1085401015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8cd95d6-4503-42bc-96da-bccc4d52f4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:23Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Creating volume d8cd95d6-4503-42bc-96da-bccc4d52f4b8 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:25 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:25 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 1073741824 Nov 05 16:25:25 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Attempting download of 54780fb8-1f74-4545-8adb-a68b477f0e9a ((None, [{'url': 'file:///opt/stack/data/glance/images/54780fb8-1f74-4545-8adb-a68b477f0e9a', 'metadata': {}}])) to volume 77e48018-f5d4-4e1c-9756-5c5d5ade9326. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9262f6-0e9b-4c49-9c39-53bc1e3f104a]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54780fb8-1f74-4545-8adb-a68b477f0e9a_xfoepovu {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:26 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 Nov 05 16:25:26 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:26 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54780fb8-1f74-4545-8adb-a68b477f0e9a_xfoepovu Nov 05 16:25:26 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:26 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64" returned: 0 in 0.398s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:26 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64 Nov 05 16:25:26 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:26 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54780fb8-1f74-4545-8adb-a68b477f0e9a_xfoepovu" returned: 0 in 0.380s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54780fb8-1f74-4545-8adb-a68b477f0e9a_xfoepovu {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:26 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 1073741824" returned: 0 in 0.495s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:26 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 Nov 05 16:25:26 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:26 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54780fb8-1f74-4545-8adb-a68b477f0e9a_xfoepovu Nov 05 16:25:26 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:26 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-4ffa2912-db34-4428-8288-c0c3ba7eba64" returned: 0 in 0.373s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-4ffa2912-db34-4428-8288-c0c3ba7eba64" released by "delete_volume" :: held 0.861s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created reservations ['1245cad2-b3d5-43f2-aadb-6a284cad271a', '33eed96b-b2e6-40d2-a0bf-a15ac7613726', '17854511-5dd9-46a2-a32b-0c9a16c3e9df', '67feabab-1704-4684-bee9-8d4dada0fa79'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:26 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54780fb8-1f74-4545-8adb-a68b477f0e9a_xfoepovu" returned: 1 in 0.441s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:26 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54780fb8-1f74-4545-8adb-a68b477f0e9a_xfoepovu' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8" returned: 0 in 0.375s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf702d-abf1-4811-8c47-3680427517e9]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.467s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026409594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90fdf24d-6648-44be-b003-f209ca546821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:23Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Creating volume 90fdf24d-6648-44be-b003-f209ca546821 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:26 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:26 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 1073741824 Nov 05 16:25:26 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad59fa6-7a5b-4890-b4d3-4121fd426093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f946cad0-7165-426b-b1af-545d68300baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-d136187e-286c-47ba-b18a-524e6e702926-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:26 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 (d8cd95d6-4503-42bc-96da-bccc4d52f4b8): created successfully Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f946cad0-7165-426b-b1af-545d68300baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (fc409422-d5c1-4c6b-aa48-c6abdb6139a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Flow 'volume_create_manager' (62326b20-48f7-48be-8154-21ec9915e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d68566-fa3b-4a0b-af06-8fdf251aa57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:27 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD Nov 05 16:25:27 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f7512b01-c5e5-4779-a45d-74fffba67966 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created volume successfully. Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-d136187e-286c-47ba-b18a-524e6e702926-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d68566-fa3b-4a0b-af06-8fdf251aa57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1777962947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f551ff-994b-482a-8719-10c3f2ef56f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4009f791f3fb43d0b68ccebd1856d09b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a279c93-4286-4ff3-92cb-961251ebe959,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:27Z,use_quota=True,user_id='7365bdbc498948deb448de404feed625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097e3c29-67c6-4059-90db-2e244ceca90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097e3c29-67c6-4059-90db-2e244ceca90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0476c233-b4ac-4c6c-a538-dc38e7513564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0476c233-b4ac-4c6c-a538-dc38e7513564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26f551ff-994b-482a-8719-10c3f2ef56f3', 'volume_name': 'volume-26f551ff-994b-482a-8719-10c3f2ef56f3', 'volume_size': 1, 'snapshot_id': '1a279c93-4286-4ff3-92cb-961251ebe959'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f573e40-004a-4f84-9d9c-10a4866c81e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f573e40-004a-4f84-9d9c-10a4866c81e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef7d321-813c-426b-a518-8f76e767d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:27 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Volume 26f551ff-994b-482a-8719-10c3f2ef56f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26f551ff-994b-482a-8719-10c3f2ef56f3', 'volume_size': 1, 'snapshot_id': '1a279c93-4286-4ff3-92cb-961251ebe959'} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:27 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:27 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-quobyte-d136187e-286c-47ba-b18a-524e6e702926" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-d136187e-286c-47ba-b18a-524e6e702926" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ff91f-1ed6-4fea-82d4-c11aa9929aba]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:27 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD" returned: 0 in 0.446s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:27 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 1073741824" returned: 0 in 0.559s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:27 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 Nov 05 16:25:27 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD Nov 05 16:25:27 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:27 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 Nov 05 16:25:27 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.313s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Deleted volume successfully. Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-526120c9-ed14-449c-bd4c-43e0c9d9a9b8 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-4ffa2912-db34-4428-8288-c0c3ba7eba64-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:27 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] 54780fb8-1f74-4545-8adb-a68b477f0e9a was raw, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:27 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 Nov 05 16:25:27 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821" returned: 0 in 0.317s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.904s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-39330310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff55e4d-9250-49a3-85e8-0cee1d4b56f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:24Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Creating volume dff55e4d-9250-49a3-85e8-0cee1d4b56f5 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:27 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:27 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926" returned: 0 in 0.503s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:27 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 1073741824 Nov 05 16:25:27 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ffc2b2-9ed9-4026-a0c8-e0778265a10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90fdf24d-6648-44be-b003-f209ca546821', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46df0ff3-8f94-477b-a14c-a7a3f16fff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:27 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926 Nov 05 16:25:27 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:27 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume volume-90fdf24d-6648-44be-b003-f209ca546821 (90fdf24d-6648-44be-b003-f209ca546821): created successfully Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46df0ff3-8f94-477b-a14c-a7a3f16fff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:27 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (8db2f3d7-d689-47a3-a9e9-b69805c0c05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6bd300b4-dda8-4e17-84f2-5bbc094a6fb2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created volume successfully. Nov 05 16:25:28 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d136187e-286c-47ba-b18a-524e6e702926" returned: 0 in 0.346s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-d136187e-286c-47ba-b18a-524e6e702926" released by "delete_volume" :: held 0.898s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created reservations ['fcb4e572-ba43-4070-ba55-3f588f6505d0', '85021c6b-6780-46ce-be9e-5ab1ba7a30e8', 'f4e9a7ff-02d7-452c-aeae-82858070092c', '6c7b226e-7e9d-4092-85f2-2cdc5be74d4f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:28 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326" returned: 0 in 0.546s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54780fb8-1f74-4545-8adb-a68b477f0e9a_yl3rdp68devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:25:28 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:28 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 1073741824" returned: 0 in 0.503s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:28 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 1G Nov 05 16:25:28 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:28 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:28 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:28 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 Nov 05 16:25:28 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:28 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.287s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Deleted volume successfully. Nov 05 16:25:28 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5" returned: 0 in 0.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.479s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1683210043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bdae85-933a-463e-85ef-f0342d8572e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:24Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Creating volume 17bdae85-933a-463e-85ef-f0342d8572e4 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:28 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:28 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 1G" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Downloaded image 54780fb8-1f74-4545-8adb-a68b477f0e9a ((None, [{'url': 'file:///opt/stack/data/glance/images/54780fb8-1f74-4545-8adb-a68b477f0e9a', 'metadata': {}}])) to volume 77e48018-f5d4-4e1c-9756-5c5d5ade9326 successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Temporary image 54780fb8-1f74-4545-8adb-a68b477f0e9a for user 9977f298b4484a72b0ba01244119a3b0 is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Marking volume 77e48018-f5d4-4e1c-9756-5c5d5ade9326 as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:25:28 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 1073741824 Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba95f0d-ced0-499f-a712-653f0505b86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:28 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1e5d03-a784-4883-83db-0aa99c5bf0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-53244873-df9b-4cd1-9111-cb5a7e92d94a tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-d136187e-286c-47ba-b18a-524e6e702926-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Copying metadata from image 54780fb8-1f74-4545-8adb-a68b477f0e9a to 77e48018-f5d4-4e1c-9756-5c5d5ade9326. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Creating volume glance metadata for volume 77e48018-f5d4-4e1c-9756-5c5d5ade9326 backed by image 54780fb8-1f74-4545-8adb-a68b477f0e9a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '54780fb8-1f74-4545-8adb-a68b477f0e9a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2a02938eab3e2aafddaddc79ad736b0e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:25:28 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 (dff55e4d-9250-49a3-85e8-0cee1d4b56f5): created successfully Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1e5d03-a784-4883-83db-0aa99c5bf0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (2acebc1a-6d7b-4bdc-86db-842b67e33b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4d7daffe-aa8a-45dc-8bdd-0cf2df6b70a2 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created volume successfully. Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23325fa-4dd0-49e0-800f-3e5567917cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326', 'volume_size': 1, 'image_id': '54780fb8-1f74-4545-8adb-a68b477f0e9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54780fb8-1f74-4545-8adb-a68b477f0e9a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a02938eab3e2aafddaddc79ad736b0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7a027f6a86484e71a3052eb6c6e364e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0c0abb2aac252e141681687c97403560c18f8cb2e82635ced73422e539851791a2cb725b307eefc9d08b58439b4f44800694ab780026a60fcaa27789f88b479a', 'id': '54780fb8-1f74-4545-8adb-a68b477f0e9a', 'created_at': datetime.datetime(2026, 11, 5, 15, 25, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 25, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54780fb8-1f74-4545-8adb-a68b477f0e9a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc716a13-9384-42f7-ba9e-e1627424702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:28 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Volume volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 (77e48018-f5d4-4e1c-9756-5c5d5ade9326): created successfully Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc716a13-9384-42f7-ba9e-e1627424702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:28 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Flow 'volume_create_manager' (dcace541-b3e3-4f18-a02b-0f8eea400547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-769c067e-7d6a-4185-bb34-7600b360882c tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Created volume successfully. Nov 05 16:25:29 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 1073741824" returned: 0 in 0.471s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:29 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 Nov 05 16:25:29 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-0224aa1f-b4e9-4378-b772-859c571f102a-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-0224aa1f-b4e9-4378-b772-859c571f102a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-quobyte-0224aa1f-b4e9-4378-b772-859c571f102a" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-0224aa1f-b4e9-4378-b772-859c571f102a" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[440cbfa8-ba62-4c12-a873-600ac937bf6f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:29 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4" returned: 0 in 0.264s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.864s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1418210665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a1c254-cf0c-4349-b77e-86fbe41ef1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5625d561cd94693acba9008dcbfffdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:24Z,use_quota=True,user_id='eadf38cbe84c415d8942e8ddceedf0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Creating volume 14a1c254-cf0c-4349-b77e-86fbe41ef1af {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:29 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388bf2e-472d-4d42-a8f8-dca0a9b15548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17bdae85-933a-463e-85ef-f0342d8572e4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899fde28-40ae-4284-92ed-e0888daed436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:29 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af 1073741824 Nov 05 16:25:29 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:29 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume volume-17bdae85-933a-463e-85ef-f0342d8572e4 (17bdae85-933a-463e-85ef-f0342d8572e4): created successfully Nov 05 16:25:29 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a Nov 05 16:25:29 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899fde28-40ae-4284-92ed-e0888daed436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (66d42808-b237-47c1-b3a2-31414bb5528e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fc4d88a4-8fee-4afa-b9f6-7ddd20c32049 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created volume successfully. Nov 05 16:25:29 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:29 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a Nov 05 16:25:29 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Acquiring lock "cinder-77e48018-f5d4-4e1c-9756-5c5d5ade9326-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "cinder-77e48018-f5d4-4e1c-9756-5c5d5ade9326-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:29 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af 1073741824" returned: 0 in 0.526s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Acquiring lock "cinder-quobyte-77e48018-f5d4-4e1c-9756-5c5d5ade9326" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "cinder-quobyte-77e48018-f5d4-4e1c-9756-5c5d5ade9326" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ca43dc-c793-4a4d-bcce-02b04c2016f5]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:30 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af Nov 05 16:25:30 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:30 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-0224aa1f-b4e9-4378-b772-859c571f102a" returned: 0 in 0.352s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-0224aa1f-b4e9-4378-b772-859c571f102a" released by "delete_volume" :: held 0.794s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created reservations ['47916bf5-3851-46db-b86f-7e2964ac24b5', '37ca4131-f275-4857-8eb7-fb51a2dbc56e', 'd5b64df3-9e68-4922-b636-7d54620efd34', '20597e36-5343-49b5-9a64-33b9a9be5eb4'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:30 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 Nov 05 16:25:30 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:30 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:30 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:30 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af" returned: 0 in 0.339s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.150s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-quobyte-1a279c93-4286-4ff3-92cb-961251ebe959-26f551ff-994b-482a-8719-10c3f2ef56f3" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da7e28d-31bd-4c1c-adda-97e2b2884707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b7ad2c-b411-4054-ac68-dea90eeab355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-1a279c93-4286-4ff3-92cb-961251ebe959-26f551ff-994b-482a-8719-10c3f2ef56f3" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Creating volume 26f551ff-994b-482a-8719-10c3f2ef56f3 from snapshot 1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-quobyte-26f551ff-994b-482a-8719-10c3f2ef56f3" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Volume volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af (14a1c254-cf0c-4349-b77e-86fbe41ef1af): created successfully Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b7ad2c-b411-4054-ac68-dea90eeab355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Flow 'volume_create_manager' (a9748174-4c50-472a-8ddf-216f96531eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-f03a8d1f-6742-48ff-8b66-76de67814e53-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-26f551ff-994b-482a-8719-10c3f2ef56f3" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] snapshot: 1a279c93-4286-4ff3-92cb-961251ebe959, volume: 26f551ff-994b-482a-8719-10c3f2ef56f3, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:25:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-46df7941-d69c-4722-b837-4ba0279d3392 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created volume successfully. Nov 05 16:25:30 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-f03a8d1f-6742-48ff-8b66-76de67814e53-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326" returned: 0 in 0.511s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b2ec8-7b04-4118-83e8-ded083c2b39b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:30 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:30 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326 Nov 05 16:25:30 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.314s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Deleted volume successfully. Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-quobyte-f03a8d1f-6742-48ff-8b66-76de67814e53" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bea7506a-8817-4001-89ae-52c8a68ff201 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-0224aa1f-b4e9-4378-b772-859c571f102a-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-f03a8d1f-6742-48ff-8b66-76de67814e53" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a66ca-d4c6-4627-ac91-cce6527a39d9]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:30 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 Nov 05 16:25:30 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:30 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 Nov 05 16:25:30 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:30 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-77e48018-f5d4-4e1c-9756-5c5d5ade9326" returned: 0 in 0.299s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "cinder-quobyte-77e48018-f5d4-4e1c-9756-5c5d5ade9326" released by "delete_volume" :: held 0.881s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:30 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Created reservations ['d35cf985-e7f4-49a4-8991-75d04b27bdd9', '126fdaa9-bd57-4554-a535-6710eb6c30d2', 'f96fe7ca-f18f-4c93-9122-a369c5a408a2', '70320021-9fb7-4123-b4e3-ea4e7e610d61'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:31 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959" returned: 0 in 0.485s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:25:31 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:31 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a520b46f-0874-4ba8-98f8-68686d428fff]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:31 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53" returned: 0 in 0.526s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:31 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 Nov 05 16:25:31 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53 Nov 05 16:25:31 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:31 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-14a1c254-cf0c-4349-b77e-86fbe41ef1af-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-14a1c254-cf0c-4349-b77e-86fbe41ef1af-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:31 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.300s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:31 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Deleted volume successfully. Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-c58dfd2d-3d0f-44f8-b942-0e4fc5b81d83 tempest-VolumeAndVolumeTypeFromImageTest-352597599 None] Lock "cinder-77e48018-f5d4-4e1c-9756-5c5d5ade9326-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-14a1c254-cf0c-4349-b77e-86fbe41ef1af" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-14a1c254-cf0c-4349-b77e-86fbe41ef1af" acquired by "delete_volume" :: waited 0.030s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ecb4c-f0b1-4e3e-b136-5ff1e799359b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:31 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f03a8d1f-6742-48ff-8b66-76de67814e53" returned: 0 in 0.330s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-f03a8d1f-6742-48ff-8b66-76de67814e53" released by "delete_volume" :: held 0.918s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:31 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" returned: 0 in 0.497s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:31 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af Nov 05 16:25:31 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:31 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 Nov 05 16:25:31 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created reservations ['2906e800-35f1-4047-93ca-ddcf8c74c247', 'c0709173-f842-4d91-b378-0f3ef3393506', '8e4a88ad-d447-437f-8900-f32513a3df75', '56bc389e-98bf-4932-aaab-e96befa2d2eb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:31 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:31 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:31 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af" returned: 0 in 0.435s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:31 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af Nov 05 16:25:31 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:32 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.299s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Deleted volume successfully. Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-29b879fe-000e-440a-9515-809a7ee245c6 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-f03a8d1f-6742-48ff-8b66-76de67814e53-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:32 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-14a1c254-cf0c-4349-b77e-86fbe41ef1af" returned: 0 in 0.325s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-14a1c254-cf0c-4349-b77e-86fbe41ef1af" released by "delete_volume" :: held 0.837s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created reservations ['5d51d583-16e2-4a3b-b73a-8f4ddf486d9e', '6f6c25c8-65b5-48cc-867e-3f064b825ea8', 'da52a4a1-763a-4af3-ad69-dfc194068043', 'dd796d6e-d36d-4f88-8165-e26d5d31bbd7'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:32 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:32 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-17bdae85-933a-463e-85ef-f0342d8572e4-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-17bdae85-933a-463e-85ef-f0342d8572e4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-17bdae85-933a-463e-85ef-f0342d8572e4" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-17bdae85-933a-463e-85ef-f0342d8572e4" acquired by "delete_volume" :: waited 0.067s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:32 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda7fa1-3ecf-4ba6-ab14-4266aebc4d78]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "cinder-quobyte-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:33 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.661s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2" acquired by "delete_volume" :: waited 0.040s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Deleted volume successfully. Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6f92bddf-2d14-4884-b992-b4c7d1f906d7 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-14a1c254-cf0c-4349-b77e-86fbe41ef1af-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91004750-4458-4ce3-8acb-663c241e64d5]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:33 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 Nov 05 16:25:33 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:33 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 Nov 05 16:25:33 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:33 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4" returned: 0 in 0.918s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:33 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4 Nov 05 16:25:33 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:34 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2" returned: 0 in 0.811s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:34 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2 Nov 05 16:25:34 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:34 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-17bdae85-933a-463e-85ef-f0342d8572e4" returned: 0 in 0.648s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:34 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-17bdae85-933a-463e-85ef-f0342d8572e4" released by "delete_volume" :: held 1.718s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2" returned: 0 in 0.589s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-quobyte-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2" released by "delete_volume" :: held 1.520s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created reservations ['9936a978-9167-470a-8298-e07e25d1130c', 'bb77f6f3-9fec-480e-9ba0-d4988775351c', 'bee9651d-aadb-4fe9-8725-85d823313c23', '981ef98b-a035-4df4-b024-0463ea7d64a9'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Created reservations ['311e47fb-772d-495d-86ef-1293f0e65362', '0b941650-284c-4b30-8bae-7e3b0c0995cf', 'ba1b4310-6401-42c3-8327-2fe8401d956f', '9d67e449-caac-4469-b2e0-f5cb8fb2cf65'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:34 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:34 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:35 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:35 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-dff55e4d-9250-49a3-85e8-0cee1d4b56f5-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-dff55e4d-9250-49a3-85e8-0cee1d4b56f5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-dff55e4d-9250-49a3-85e8-0cee1d4b56f5" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-dff55e4d-9250-49a3-85e8-0cee1d4b56f5" acquired by "delete_volume" :: waited 0.063s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:35 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.598s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Deleted volume successfully. Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[94667525-c66b-40a2-b03c-44585e040598]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8bbc48f7-37df-444b-970e-1cd8d17f638d tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-17bdae85-933a-463e-85ef-f0342d8572e4-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:35 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.707s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Deleted volume successfully. Nov 05 16:25:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7cc23ec5-171d-4a40-bc73-7f34262b5c36 tempest-CreateVolumesFromSourceVolumeTest-166354338 None] Lock "cinder-385eb78d-fcfe-4343-bfc6-bf5e87c16fb2-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:35 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 Nov 05 16:25:35 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:36 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5" returned: 0 in 0.928s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:36 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5 Nov 05 16:25:36 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:37 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-dff55e4d-9250-49a3-85e8-0cee1d4b56f5" returned: 0 in 0.579s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-dff55e4d-9250-49a3-85e8-0cee1d4b56f5" released by "delete_volume" :: held 1.663s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created reservations ['7bb6b663-276d-46d3-b5d4-eb94a193c6c0', '5d267590-2a4d-4ced-a570-63e7af7bfbe6', '125d7d06-42bf-4a6c-ab24-b9b3d52c48aa', '9bdae2af-195c-475e-9e31-789e36cbe69f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:37 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:37 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-90fdf24d-6648-44be-b003-f209ca546821-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-90fdf24d-6648-44be-b003-f209ca546821-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-90fdf24d-6648-44be-b003-f209ca546821" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-90fdf24d-6648-44be-b003-f209ca546821" acquired by "delete_volume" :: waited 0.040s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:38 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.686s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:38 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a553de-b5cd-4c8e-b532-95dcf73542a8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Deleted volume successfully. Nov 05 16:25:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0fd0837f-9f58-4820-81a9-dd8ed648c1fd tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-dff55e4d-9250-49a3-85e8-0cee1d4b56f5-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:38 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 Nov 05 16:25:38 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:39 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821" returned: 0 in 0.901s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:39 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821 Nov 05 16:25:39 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:39 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-90fdf24d-6648-44be-b003-f209ca546821" returned: 0 in 0.715s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-90fdf24d-6648-44be-b003-f209ca546821" released by "delete_volume" :: held 1.786s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:39 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created reservations ['ee35137c-a52c-45ef-ae06-35b04dbd7a73', 'c4fe0013-f48d-4d2b-b737-8c5f9f2ca526', '419c4bba-c180-44bb-aede-da6bc643d52b', '8d56dcb4-2f18-43e5-b274-ad70956a7784'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:40 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:40 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-d8cd95d6-4503-42bc-96da-bccc4d52f4b8-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-d8cd95d6-4503-42bc-96da-bccc4d52f4b8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-d8cd95d6-4503-42bc-96da-bccc4d52f4b8" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-d8cd95d6-4503-42bc-96da-bccc4d52f4b8" acquired by "delete_volume" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:40 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.602s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:40 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Deleted volume successfully. Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2aab9ee6-d9d2-438c-a995-dd890a64cdb5 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-90fdf24d-6648-44be-b003-f209ca546821-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce28e3e-9fe1-4b5e-86f3-8f4e668424fd]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:41 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 Nov 05 16:25:41 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:41 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8" returned: 0 in 0.672s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:41 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3" returned: 0 in 9.946s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251, size 1024.00 MB, duration 9.95 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:25:41 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Converted 1024.00 MB image at 102.94 MB/s Nov 05 16:25:41 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 is being set with open permissions: ugo+rw Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:41 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8 Nov 05 16:25:41 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:41 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 Nov 05 16:25:41 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (454f31bd-b050-4e34-94b3-d9298c9955fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cad373-0149-4860-a157-a9a7c1ecbe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cad373-0149-4860-a157-a9a7c1ecbe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1920809063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ac0242-5563-4dd5-93fa-45bdbc4f9a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:42Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c1fb3-6dab-4364-bc4c-ea7def68bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4c1fb3-6dab-4364-bc4c-ea7def68bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6394d1-8ddf-453e-b4ef-dc3342ae8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6394d1-8ddf-453e-b4ef-dc3342ae8254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ac0242-5563-4dd5-93fa-45bdbc4f9a23', 'volume_name': 'volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4cb973-15ab-4671-b4f1-b4fbc6d53613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4cb973-15ab-4671-b4f1-b4fbc6d53613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb49f0-178f-4cf7-aa38-fc4f1a81aff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:41 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Volume 78ac0242-5563-4dd5-93fa-45bdbc4f9a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23', 'volume_size': 1} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:41 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d8cd95d6-4503-42bc-96da-bccc4d52f4b8" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-d8cd95d6-4503-42bc-96da-bccc4d52f4b8" released by "delete_volume" :: held 1.171s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created reservations ['2b14acba-682a-4f8b-b785-b1b015978082', 'c33354a4-949d-4471-b738-f70583392880', '41c82688-8edc-47b0-9ff6-b84c9bac8e44', 'fa251fd2-9d0b-4d29-9160-1e0ff20a9dc8'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:41 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3" returned: 0 in 0.448s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-26f551ff-994b-482a-8719-10c3f2ef56f3" released by "_copy_volume_from_snapshot" :: held 11.547s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-1a279c93-4286-4ff3-92cb-961251ebe959-26f551ff-994b-482a-8719-10c3f2ef56f3" released by "_create_volume_from_snapshot" :: held 11.694s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.733s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1920809063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ac0242-5563-4dd5-93fa-45bdbc4f9a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:42Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Creating volume 78ac0242-5563-4dd5-93fa-45bdbc4f9a23 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:42 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:42 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 1073741824 Nov 05 16:25:42 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef7d321-813c-426b-a518-8f76e767d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f551ff-994b-482a-8719-10c3f2ef56f3', 'volume_size': 1, 'snapshot_id': '1a279c93-4286-4ff3-92cb-961251ebe959'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3bad9e-8af0-43ec-810b-bb4ef91a9a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:42 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:42 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Volume volume-26f551ff-994b-482a-8719-10c3f2ef56f3 (26f551ff-994b-482a-8719-10c3f2ef56f3): created successfully Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3bad9e-8af0-43ec-810b-bb4ef91a9a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Flow 'volume_create_manager' (62326b20-48f7-48be-8154-21ec9915e371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (a314d627-4b1c-4eb2-a7f0-14b84b5c2171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319b1ceb-1240-49af-94f9-9985a3009bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319b1ceb-1240-49af-94f9-9985a3009bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546566390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a0a569-e08f-43b6-aeae-1876f15d917c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:42Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dc132f-1e97-4cbf-94fc-701cd54457b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dc132f-1e97-4cbf-94fc-701cd54457b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcdfc22-afcc-41a4-a43e-4e83f058c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcdfc22-afcc-41a4-a43e-4e83f058c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a0a569-e08f-43b6-aeae-1876f15d917c', 'volume_name': 'volume-34a0a569-e08f-43b6-aeae-1876f15d917c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a9b466-2569-4bdf-8471-de5de7fd930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a9b466-2569-4bdf-8471-de5de7fd930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1316d7-d9a0-45e3-815e-882e6b9920fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Volume 34a0a569-e08f-43b6-aeae-1876f15d917c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a0a569-e08f-43b6-aeae-1876f15d917c', 'volume_size': 1} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bad760da-ef93-45bf-83ef-755927139e83 tempest-VolumeDependencyTests-758635139 None] Created volume successfully. Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-1a279c93-4286-4ff3-92cb-961251ebe959-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-1a279c93-4286-4ff3-92cb-961251ebe959-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-quobyte-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (c8fd9997-843b-4b37-b8b2-5f54bd411ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:42 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a748147-8f2b-45f3-a622-87dc0172b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.692s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a748147-8f2b-45f3-a622-87dc0172b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1504035782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff2d8a3-f3e6-45be-bbb0-8955334ad606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:43Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df51c0b-0d61-4fa8-a66d-6e680cdd8670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df51c0b-0d61-4fa8-a66d-6e680cdd8670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968751d6-af5d-4a20-890e-b7c0ab603569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968751d6-af5d-4a20-890e-b7c0ab603569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff2d8a3-f3e6-45be-bbb0-8955334ad606', 'volume_name': 'volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa491d0-9f63-4d04-ba3b-92f20e4fa08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa491d0-9f63-4d04-ba3b-92f20e4fa08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148f8a12-6543-4cbb-af9a-6372a4d8bec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:42 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Volume 8ff2d8a3-f3e6-45be-bbb0-8955334ad606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606', 'volume_size': 1} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" acquired by "delete_snapshot" :: waited 0.202s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-quobyte-1a279c93-4286-4ff3-92cb-961251ebe959" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-34abae16-c9ec-452d-be4c-0fb51812b1c4-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Deleted volume successfully. Nov 05 16:25:42 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 1073741824" returned: 0 in 0.858s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-1a279c93-4286-4ff3-92cb-961251ebe959" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Deleting offline snapshot 1a279c93-4286-4ff3-92cb-961251ebe959 of volume 9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] snapshot_file for this snap is: volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-aeba15b3-bf0c-44af-b50d-47250cfab803 tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-d8cd95d6-4503-42bc-96da-bccc4d52f4b8-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-34abae16-c9ec-452d-be4c-0fb51812b1c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbdcbfe-8bda-4a29-b292-b2110f115c1d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" acquired by "delete_snapshot" :: waited 0.084s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-34abae16-c9ec-452d-be4c-0fb51812b1c4" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-34abae16-c9ec-452d-be4c-0fb51812b1c4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:43 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 Nov 05 16:25:43 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Deleting offline snapshot 34abae16-c9ec-452d-be4c-0fb51812b1c4 of volume 3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] snapshot_file for this snap is: volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c0f12-e3d7-4df3-bb72-a68a4896b4f8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:43 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 Nov 05 16:25:43 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (d9c0ca9e-95ee-479b-a096-0299272249c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12d879b-61c4-4ecd-8ea8-598bc396a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12d879b-61c4-4ecd-8ea8-598bc396a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735153883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04009d12-d06b-49e7-b265-acf059bf52f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:43Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029fc656-866c-4dd0-87b4-656ad201bed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029fc656-866c-4dd0-87b4-656ad201bed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94340277-dcb7-400e-ac2f-a3b5d024cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94340277-dcb7-400e-ac2f-a3b5d024cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04009d12-d06b-49e7-b265-acf059bf52f4', 'volume_name': 'volume-04009d12-d06b-49e7-b265-acf059bf52f4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf821a92-ea3e-4462-88e4-55979536b5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf821a92-ea3e-4462-88e4-55979536b5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b854d46d-cb0d-49eb-8d27-5338a1a259e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Volume 04009d12-d06b-49e7-b265-acf059bf52f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04009d12-d06b-49e7-b265-acf059bf52f4', 'volume_size': 1} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:43 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23" returned: 0 in 0.294s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546566390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a0a569-e08f-43b6-aeae-1876f15d917c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:42Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Creating volume 34a0a569-e08f-43b6-aeae-1876f15d917c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:43 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb49f0-178f-4cf7-aa38-fc4f1a81aff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227d7872-772d-4c1d-afcf-8bb10f00dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:43 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c 1073741824 Nov 05 16:25:43 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:43 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 Nov 05 16:25:43 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Volume volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 (78ac0242-5563-4dd5-93fa-45bdbc4f9a23): created successfully Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227d7872-772d-4c1d-afcf-8bb10f00dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (454f31bd-b050-4e34-94b3-d9298c9955fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a28e92c5-6a45-4af4-8973-8279d2f5effa tempest-CreateVolumesFromImageTest-1529427237 None] Created volume successfully. Nov 05 16:25:43 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959" returned: 0 in 0.694s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65fa07a-fa48-4b91-b0fb-89996fed4e60]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:43 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4" returned: 0 in 0.645s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a70e3f-a0e9-43ea-9272-88ddf5ae0032]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:44 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 Nov 05 16:25:44 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:44 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c 1073741824" returned: 0 in 0.662s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (05ba3474-3190-4b30-82b0-e4f1c6fd5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ebf5d2-9f0a-45e4-a8cb-4da3b021cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:44 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b Nov 05 16:25:44 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ebf5d2-9f0a-45e4-a8cb-4da3b021cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717899645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96dd02ff-7736-421a-a387-1d6e9b8ca35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:44Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4f22c7-445e-40c6-820a-0338b953132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4f22c7-445e-40c6-820a-0338b953132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b22d0e-3e47-47f7-8cc9-672287c1ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b22d0e-3e47-47f7-8cc9-672287c1ca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96dd02ff-7736-421a-a387-1d6e9b8ca35d', 'volume_name': 'volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b22c5c8-6e12-47ff-8c22-81b69f911af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b22c5c8-6e12-47ff-8c22-81b69f911af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42df6cb-9d7c-4c98-99b5-85c407194590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:44 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Volume 96dd02ff-7736-421a-a387-1d6e9b8ca35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d', 'volume_size': 1} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:44 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c Nov 05 16:25:44 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:44 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" returned: 0 in 0.571s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:44 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c" returned: 0 in 0.340s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:44 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 Nov 05 16:25:44 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1504035782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff2d8a3-f3e6-45be-bbb0-8955334ad606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:43Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Creating volume 8ff2d8a3-f3e6-45be-bbb0-8955334ad606 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:44 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:44 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" returned: 0 in 0.774s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:44 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 1073741824 Nov 05 16:25:44 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1316d7-d9a0-45e3-815e-882e6b9920fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a0a569-e08f-43b6-aeae-1876f15d917c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023f3415-d75c-4ead-9301-a1e794e1f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:44 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 Nov 05 16:25:44 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:44 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Volume volume-34a0a569-e08f-43b6-aeae-1876f15d917c (34a0a569-e08f-43b6-aeae-1876f15d917c): created successfully Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023f3415-d75c-4ead-9301-a1e794e1f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:44 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (a314d627-4b1c-4eb2-a7f0-14b84b5c2171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:44 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6a187a74-16a5-44db-a536-db3ed57848d5 tempest-CreateVolumesFromImageTest-1529427237 None] Created volume successfully. Nov 05 16:25:45 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4" returned: 0 in 0.445s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:45 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4 Nov 05 16:25:45 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:45 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959" returned: 0 in 0.442s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:45 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959 Nov 05 16:25:45 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:45 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 1073741824" returned: 0 in 0.618s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:45 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b.34abae16-c9ec-452d-be4c-0fb51812b1c4" returned: 0 in 0.327s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:45 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 Nov 05 16:25:45 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-34abae16-c9ec-452d-be4c-0fb51812b1c4" released by "_delete_snapshot" :: held 2.218s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" released by "delete_snapshot" :: held 2.262s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:45 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251.1a279c93-4286-4ff3-92cb-961251ebe959" returned: 0 in 0.391s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-1a279c93-4286-4ff3-92cb-961251ebe959" released by "_delete_snapshot" :: held 2.514s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" released by "delete_snapshot" :: held 2.573s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created reservations ['09169fe7-d571-4e5e-861e-2760073d0c5d', '485d0e45-5212-46d2-81c6-61be8cfe7988', 'b9b326cb-7401-4094-a98b-1dfcb945af4a', 'b4b9d563-528e-462e-8262-7e23a5a60cf0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Created reservations ['c960470f-0326-4ec8-a77a-68366c025707', '9361b39b-dde2-4348-80e9-2c193f8e8ddb', '351f4b6b-06af-42f7-857c-5e378ecc77f9', 'aac2f8da-ca2b-4ca2-b676-34adad9e1986'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:45 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606" returned: 0 in 0.390s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.254s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735153883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04009d12-d06b-49e7-b265-acf059bf52f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:43Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Creating volume 04009d12-d06b-49e7-b265-acf059bf52f4 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:45 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148f8a12-6543-4cbb-af9a-6372a4d8bec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:45 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 1073741824 Nov 05 16:25:45 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d556c0-e7f5-4a77-b3a9-d2390dd5902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Delete snapshot completed successfully. Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-38d6909c-e1cc-40b0-be32-c11ed4c3a23b tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-34abae16-c9ec-452d-be4c-0fb51812b1c4-delete_snapshot" released by "delete_snapshot" :: held 2.676s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:45 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Volume volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 (8ff2d8a3-f3e6-45be-bbb0-8955334ad606): created successfully Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d556c0-e7f5-4a77-b3a9-d2390dd5902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (c8fd9997-843b-4b37-b8b2-5f54bd411ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-565f52c5-5593-4d2b-af0d-ac1a2cb373ab tempest-CreateVolumesFromImageTest-1529427237 None] Created volume successfully. Nov 05 16:25:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Delete snapshot completed successfully. Nov 05 16:25:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a7643b9a-55cd-4774-9c5c-83559194b051 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-1a279c93-4286-4ff3-92cb-961251ebe959-delete_snapshot" released by "delete_snapshot" :: held 3.048s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-9b7a3c1e-d934-4fbf-b1fb-eb442178b251-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-9b7a3c1e-d934-4fbf-b1fb-eb442178b251-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-quobyte-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b07f366-6927-49ac-b9e2-e29cc2d2a506]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:46 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 1073741824" returned: 0 in 0.613s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "cinder-quobyte-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:46 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 Nov 05 16:25:46 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead0cfa-7167-4a86-b41f-90617caafdec]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:46 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 Nov 05 16:25:46 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:46 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b Nov 05 16:25:46 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:46 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" returned: 0 in 0.455s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:46 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:46 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251 Nov 05 16:25:46 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.461s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-717899645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96dd02ff-7736-421a-a387-1d6e9b8ca35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7879847bed784d8d8c31d271f1e707cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:44Z,use_quota=True,user_id='30b73feb56dd413ea0dcee63d8e4ddfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Creating volume 96dd02ff-7736-421a-a387-1d6e9b8ca35d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:46 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b854d46d-cb0d-49eb-8d27-5338a1a259e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04009d12-d06b-49e7-b265-acf059bf52f4', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a97759d-5629-4813-a1b5-cb7c6de4394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:46 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d 1073741824 Nov 05 16:25:46 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:46 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Volume volume-04009d12-d06b-49e7-b265-acf059bf52f4 (04009d12-d06b-49e7-b265-acf059bf52f4): created successfully Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a97759d-5629-4813-a1b5-cb7c6de4394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (d9c0ca9e-95ee-479b-a096-0299272249c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-523296b1-2a18-4d9e-bba3-3f2e86466af4 tempest-CreateVolumesFromImageTest-1529427237 None] Created volume successfully. Nov 05 16:25:46 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" returned: 0 in 0.536s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:46 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b Nov 05 16:25:46 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:47 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" returned: 0 in 0.376s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-9b7a3c1e-d934-4fbf-b1fb-eb442178b251" released by "delete_volume" :: held 0.930s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Created reservations ['a75f5e5b-ca55-4fde-8e99-9427bac9aa08', 'c47a7107-10b5-47b7-be3e-30e1a5c13420', 'e1822355-a680-4627-8a75-04f05a6600e3', '319d3b30-bf5a-4e79-9f83-6abf03bd2f39'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:47 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:47 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:47 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" returned: 0 in 0.327s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-quobyte-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b" released by "delete_volume" :: held 0.951s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-26f551ff-994b-482a-8719-10c3f2ef56f3-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:47 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-26f551ff-994b-482a-8719-10c3f2ef56f3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d 1073741824" returned: 0 in 0.657s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "cinder-quobyte-26f551ff-994b-482a-8719-10c3f2ef56f3" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-26f551ff-994b-482a-8719-10c3f2ef56f3" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:47 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d Nov 05 16:25:47 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Created reservations ['46ce97d7-07bc-4173-8612-e70d588b196d', '4cb18e60-7af8-4bc4-95b7-49b49fcc029a', 'eb6768ba-10b7-4a9b-8ef2-8a355f6b0264', 'dd0b703d-4ae0-4e3c-9ae3-9ec46f7f1e96'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b15042-5197-4581-8fbe-5dc552d1685c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:47 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.392s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Deleted volume successfully. Nov 05 16:25:47 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:47 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:47 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 Nov 05 16:25:47 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-50d59c17-fb91-4069-abf7-7b3b9a023ae8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-9b7a3c1e-d934-4fbf-b1fb-eb442178b251-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:47 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d" returned: 0 in 0.336s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42df6cb-9d7c-4c98-99b5-85c407194590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9974eb-aaf6-4330-b0b8-c9ba42e5805e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:47 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Volume volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d (96dd02ff-7736-421a-a387-1d6e9b8ca35d): created successfully Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9974eb-aaf6-4330-b0b8-c9ba42e5805e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Flow 'volume_create_manager' (05ba3474-3190-4b30-82b0-e4f1c6fd5569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e47f114a-cd0f-4f16-b2a1-269349c5f5f4 tempest-CreateVolumesFromImageTest-1529427237 None] Created volume successfully. Nov 05 16:25:48 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:48 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3" returned: 0 in 0.513s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.439s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-96dd02ff-7736-421a-a387-1d6e9b8ca35d-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:48 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3 Nov 05 16:25:48 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:48 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Deleted volume successfully. Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-96dd02ff-7736-421a-a387-1d6e9b8ca35d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ebcad494-c6f5-49e0-9111-f4ded7c339ac tempest-CreateVolumesFromSnapshotTest-1019201069 None] Lock "cinder-3dfe5fca-4b99-4fc6-8732-7659bf0cdc5b-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-quobyte-96dd02ff-7736-421a-a387-1d6e9b8ca35d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-96dd02ff-7736-421a-a387-1d6e9b8ca35d" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[012eba66-e1f6-4d3b-9ae3-54218ca8254d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:48 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-26f551ff-994b-482a-8719-10c3f2ef56f3" returned: 0 in 0.293s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:48 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d Nov 05 16:25:48 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-quobyte-26f551ff-994b-482a-8719-10c3f2ef56f3" released by "delete_volume" :: held 0.880s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Created reservations ['cdbff20c-0d12-4fa0-961e-b113ebe7a09f', '7685ade3-ed8f-4bfb-ad20-865a6f4f533b', '2ba8e84d-7a62-4034-949a-6854187b2753', 'da08855c-700a-4afa-9f2f-1445558c11c6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:48 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:48 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:48 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d" returned: 0 in 0.432s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:48 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d Nov 05 16:25:48 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:48 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.305s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:48 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Deleted volume successfully. Nov 05 16:25:48 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0038b801-7a03-4262-a16f-2770bd1987c8 tempest-VolumeDependencyTests-758635139 None] Lock "cinder-26f551ff-994b-482a-8719-10c3f2ef56f3-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:49 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-96dd02ff-7736-421a-a387-1d6e9b8ca35d" returned: 0 in 0.338s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-96dd02ff-7736-421a-a387-1d6e9b8ca35d" released by "delete_volume" :: held 0.817s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Created reservations ['b21742a6-2eb2-467b-a391-ed9709c415a8', 'ff0cfb7b-fa2f-488d-aa42-f8b792dd74cf', 'fa521e4c-80f1-410a-82d0-d85f0c3eacb6', 'a795bb64-8d49-475d-8916-644c86f28c29'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:49 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:49 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-04009d12-d06b-49e7-b265-acf059bf52f4-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-04009d12-d06b-49e7-b265-acf059bf52f4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-quobyte-04009d12-d06b-49e7-b265-acf059bf52f4" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (942744e4-735a-4b1f-997d-df322b55f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b639a-9d8b-47ca-9ba7-59bad26ba9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-04009d12-d06b-49e7-b265-acf059bf52f4" acquired by "delete_volume" :: waited 0.077s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b639a-9d8b-47ca-9ba7-59bad26ba9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2137246465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb73c3dd-2874-417b-b916-9b968c09d43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:49Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30534e62-3264-40ff-a2f2-b8b7a52e131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30534e62-3264-40ff-a2f2-b8b7a52e131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1382335-80ee-4dde-8b24-6df7895b429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1382335-80ee-4dde-8b24-6df7895b429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb73c3dd-2874-417b-b916-9b968c09d43c', 'volume_name': 'volume-eb73c3dd-2874-417b-b916-9b968c09d43c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9a0f34-4271-4bce-9f1b-d822df5c483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9a0f34-4271-4bce-9f1b-d822df5c483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9598773f-8a48-47fa-8f2f-d356aacd5286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:49 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Volume eb73c3dd-2874-417b-b916-9b968c09d43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb73c3dd-2874-417b-b916-9b968c09d43c', 'volume_size': 1} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2137246465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb73c3dd-2874-417b-b916-9b968c09d43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:49Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Creating volume eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:49 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[20115d19-8f86-4a8a-bd1e-fec2b026c538]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:49 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c 1073741824 Nov 05 16:25:49 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:49 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.466s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:49 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Deleted volume successfully. Nov 05 16:25:49 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-03b24ddf-ce40-47af-af61-bf3663fa98da tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-96dd02ff-7736-421a-a387-1d6e9b8ca35d-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:49 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 Nov 05 16:25:49 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:50 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4" returned: 0 in 0.492s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:50 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4 Nov 05 16:25:50 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:50 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c 1073741824" returned: 0 in 0.562s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:50 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:50 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:50 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c Nov 05 16:25:50 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:50 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.310s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:25:50 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-04009d12-d06b-49e7-b265-acf059bf52f4" returned: 0 in 0.446s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-04009d12-d06b-49e7-b265-acf059bf52f4" released by "delete_volume" :: held 1.087s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:50 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Created reservations ['beb5e1aa-e41a-4bd9-9ed0-be068afef20a', 'dfca47b3-6b3b-44c2-85fd-7fa7d1b864be', '4f6a9366-2f30-49b1-83b9-4d3abeed0e1b', '7d3213d8-d8f2-46a8-90a8-0d12cdeec78d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9598773f-8a48-47fa-8f2f-d356aacd5286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb73c3dd-2874-417b-b916-9b968c09d43c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f47899-899a-435d-88c3-8e5dbc554586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:50 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Volume volume-eb73c3dd-2874-417b-b916-9b968c09d43c (eb73c3dd-2874-417b-b916-9b968c09d43c): created successfully Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f47899-899a-435d-88c3-8e5dbc554586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (942744e4-735a-4b1f-997d-df322b55f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:50 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d5b220bf-ac20-4e21-81fe-daf4aa3ed3aa tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:50 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:50 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:51 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.257s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:51 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:51 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Deleted volume successfully. Nov 05 16:25:51 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f9c11191-bcc3-4cd0-acab-ba4e582d3efc tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-04009d12-d06b-49e7-b265-acf059bf52f4-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot d494a288-0259-4ee2-9a02-da225d51ce7e of volume eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-8ff2d8a3-f3e6-45be-bbb0-8955334ad606-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-8ff2d8a3-f3e6-45be-bbb0-8955334ad606-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794f9f2-7c79-43ce-a50e-a04313e0957c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-quobyte-8ff2d8a3-f3e6-45be-bbb0-8955334ad606" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-8ff2d8a3-f3e6-45be-bbb0-8955334ad606" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8c44cd-6f6f-45ea-bbae-5289c54bd3c4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:52 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c Nov 05 16:25:52 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:52 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 Nov 05 16:25:52 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Flow 'volume_create_manager' (761d7710-e8bf-4c10-ae86-2ca409b4c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2531dcd3-4fb7-49b9-9138-614c18997a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2531dcd3-4fb7-49b9-9138-614c18997a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a1620a-5ac6-4f81-a6fe-dc88101f0c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91fe86c78d949faa98d508d29e30dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:52Z,use_quota=True,user_id='a6f9e5687d5742d083a8eb2e335771b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24e82e6-58a8-4e33-b24b-ec33bd5d2260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24e82e6-58a8-4e33-b24b-ec33bd5d2260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4539be00-5b3a-4421-ad2d-52419b3b7381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4539be00-5b3a-4421-ad2d-52419b3b7381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a1620a-5ac6-4f81-a6fe-dc88101f0c84', 'volume_name': 'volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fb177f-c4cc-4e46-890c-bb3fb8e6c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fb177f-c4cc-4e46-890c-bb3fb8e6c068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db60c34-5969-4e19-8ad1-7c04fd9b4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:52 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Volume 54a1620a-5ac6-4f81-a6fe-dc88101f0c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84', 'volume_size': 1} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:52 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606" returned: 0 in 0.390s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:52 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c" returned: 0 in 0.535s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:52 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606 Nov 05 16:25:52 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:52 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e 1G Nov 05 16:25:52 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:52 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8ff2d8a3-f3e6-45be-bbb0-8955334ad606" returned: 0 in 0.277s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-8ff2d8a3-f3e6-45be-bbb0-8955334ad606" released by "delete_volume" :: held 0.736s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Created reservations ['0db17599-9e32-4175-9e89-b226607e5319', 'f1fd76ee-c161-4c2f-80af-186ee3e2dc2b', '19d266e7-81ad-4c11-afd4-f39967d23e4f', '51b7efce-c721-47c1-ab2f-cdcb2e4090da'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:53 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:53 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:53 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e 1G" returned: 0 in 0.504s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb73c3dd-2874-417b-b916-9b968c09d43c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:53 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb73c3dd-2874-417b-b916-9b968c09d43c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e Nov 05 16:25:53 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-34a0a569-e08f-43b6-aeae-1876f15d917c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:53 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.312s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:53 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Deleted volume successfully. Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-34a0a569-e08f-43b6-aeae-1876f15d917c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b83acddf-2889-4735-890e-e4bdcac02e17 tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-8ff2d8a3-f3e6-45be-bbb0-8955334ad606-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-quobyte-34a0a569-e08f-43b6-aeae-1876f15d917c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-34a0a569-e08f-43b6-aeae-1876f15d917c" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:53 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cdc16b-0c8f-4380-ab10-5d6d89c32432]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb73c3dd-2874-417b-b916-9b968c09d43c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e" returned: 0 in 0.369s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:53 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e is being set with open permissions: ugo+rw Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:53 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e Nov 05 16:25:53 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:53 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c Nov 05 16:25:53 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:53 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e" returned: 0 in 0.284s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-50498c79-d843-4bc7-b6ee-539bc14982c5 tempest-ProjectAdminTests-1329434090 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.458740234375, 'free_capacity_gb': 1773.458740234375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86924) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 16:25:53 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.info Nov 05 16:25:53 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:53 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c" returned: 0 in 0.417s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:53 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c Nov 05 16:25:53 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:54 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.info" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:54 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.info is being set with open permissions: ugo+rw Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:54 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.info Nov 05 16:25:54 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:54 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34a0a569-e08f-43b6-aeae-1876f15d917c" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-34a0a569-e08f-43b6-aeae-1876f15d917c" released by "delete_volume" :: held 0.776s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Created reservations ['b1112c98-30a5-4a86-8ad9-f65d27fd4836', 'f33b576c-cb32-44b2-8033-4805730cc62e', 'c462772a-f493-461e-b323-5359870d0753', 'cd241975-f4ea-496e-ad5c-1636fe1af9db'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:54 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:54 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:54 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.info" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.917s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a1620a-5ac6-4f81-a6fe-dc88101f0c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91fe86c78d949faa98d508d29e30dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:52Z,use_quota=True,user_id='a6f9e5687d5742d083a8eb2e335771b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Creating volume 54a1620a-5ac6-4f81-a6fe-dc88101f0c84 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:54 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:54 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 1073741824 Nov 05 16:25:54 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b5cc5fa0-ae26-4dd3-be62-cd7b879f7321 tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-78ac0242-5563-4dd5-93fa-45bdbc4f9a23-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-78ac0242-5563-4dd5-93fa-45bdbc4f9a23-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "cinder-quobyte-78ac0242-5563-4dd5-93fa-45bdbc4f9a23" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-78ac0242-5563-4dd5-93fa-45bdbc4f9a23" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:54 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.341s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Deleted volume successfully. Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d29aa09-c2df-4aaf-b63b-1d4453e94869]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-5e9edf83-ea1f-41f9-b330-50d794da756e tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-34a0a569-e08f-43b6-aeae-1876f15d917c-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:54 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 Nov 05 16:25:54 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:55 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 1073741824" returned: 0 in 0.548s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:55 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 Nov 05 16:25:55 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:55 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23" returned: 0 in 0.457s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-d494a288-0259-4ee2-9a02-da225d51ce7e-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:55 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23 Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-d494a288-0259-4ee2-9a02-da225d51ce7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-eb73c3dd-2874-417b-b916-9b968c09d43c" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:55 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-eb73c3dd-2874-417b-b916-9b968c09d43c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-d494a288-0259-4ee2-9a02-da225d51ce7e" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-d494a288-0259-4ee2-9a02-da225d51ce7e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot d494a288-0259-4ee2-9a02-da225d51ce7e of volume eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b579a6a-05b1-415f-9c73-87ec35b33a79]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:55 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84" returned: 0 in 0.325s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db60c34-5969-4e19-8ad1-7c04fd9b4de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a947bf6-b7d7-4874-ad6f-18a5847cf9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:55 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Volume volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 (54a1620a-5ac6-4f81-a6fe-dc88101f0c84): created successfully Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a947bf6-b7d7-4874-ad6f-18a5847cf9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Flow 'volume_create_manager' (761d7710-e8bf-4c10-ae86-2ca409b4c976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-9959ea72-d422-47df-92b1-fe2db44b8270 tempest-CinderUnicodeTest-2007885074 None] Created volume successfully. Nov 05 16:25:55 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e Nov 05 16:25:55 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:55 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-78ac0242-5563-4dd5-93fa-45bdbc4f9a23" returned: 0 in 0.369s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-quobyte-78ac0242-5563-4dd5-93fa-45bdbc4f9a23" released by "delete_volume" :: held 0.886s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Created reservations ['77193d3a-7cfc-4a9d-82e1-23f648d44ce6', '8899a645-8d47-4b1f-a11f-553253a7dcc9', '84c66cdb-cc82-48cb-b519-c2ff62aabc2a', 'b8add0f3-bd43-4a76-911f-43ea7053a94d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:55 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e" returned: 0 in 0.490s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb73c3dd-2874-417b-b916-9b968c09d43c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[40375e92-93f8-4632-8c04-16c3212f4953]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:55 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:55 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:56 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c Nov 05 16:25:56 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:56 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.478s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:25:56 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:56 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Deleted volume successfully. Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c" returned: 0 in 0.493s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:56 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e Nov 05 16:25:56 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-11363a68-bc86-4b72-ae18-22f8e496ee6a tempest-CreateVolumesFromImageTest-1529427237 None] Lock "cinder-78ac0242-5563-4dd5-93fa-45bdbc4f9a23-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Flow 'volume_create_manager' (a1b16a18-090a-441b-9c73-e498259378ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704d60a5-9e8a-4cab-b668-67912c96060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704d60a5-9e8a-4cab-b668-67912c96060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-455018670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fe3459-9085-463c-885c-b46f1a58d543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91fe86c78d949faa98d508d29e30dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:56Z,use_quota=True,user_id='a6f9e5687d5742d083a8eb2e335771b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd45cae-657e-45a7-a469-2b203ed69c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd45cae-657e-45a7-a469-2b203ed69c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99be502-2de0-4cfb-a970-f3ed96f2baec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99be502-2de0-4cfb-a970-f3ed96f2baec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fe3459-9085-463c-885c-b46f1a58d543', 'volume_name': 'volume-49fe3459-9085-463c-885c-b46f1a58d543', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d372c5c-e391-4971-a3da-ad650df049c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d372c5c-e391-4971-a3da-ad650df049c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4aef85-ec56-4208-baed-730485fe3f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:56 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Volume 49fe3459-9085-463c-885c-b46f1a58d543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fe3459-9085-463c-885c-b46f1a58d543', 'volume_size': 1} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:25:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-455018670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fe3459-9085-463c-885c-b46f1a58d543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e91fe86c78d949faa98d508d29e30dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:25:56Z,use_quota=True,user_id='a6f9e5687d5742d083a8eb2e335771b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Creating volume 49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:25:56 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:56 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 1073741824 Nov 05 16:25:56 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:56 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e" returned: 0 in 0.527s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:57 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e Nov 05 16:25:57 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:57 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 1073741824" returned: 0 in 0.628s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:57 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c.d494a288-0259-4ee2-9a02-da225d51ce7e" returned: 0 in 0.368s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:57 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 Nov 05 16:25:57 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-d494a288-0259-4ee2-9a02-da225d51ce7e" released by "_delete_snapshot" :: held 2.048s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-eb73c3dd-2874-417b-b916-9b968c09d43c" released by "delete_snapshot" :: held 2.080s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Created reservations ['5eea321e-c6f6-4802-a1d2-456d673d79cf', '40e1891f-3d96-4445-a323-5ec790690090', '3b43b3a7-ae26-468f-8ac1-7d25eb1de93e', 'dcb4b118-3036-4f72-95b0-0d7eb619fd89'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-be2c56ea-5036-4255-badb-3e2a0d0ce759 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-d494a288-0259-4ee2-9a02-da225d51ce7e-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:57 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543" returned: 0 in 0.370s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4aef85-ec56-4208-baed-730485fe3f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fe3459-9085-463c-885c-b46f1a58d543', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf8126d-73e9-4b54-b3de-aed1d9c29a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:25:57 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Volume volume-49fe3459-9085-463c-885c-b46f1a58d543 (49fe3459-9085-463c-885c-b46f1a58d543): created successfully Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf8126d-73e9-4b54-b3de-aed1d9c29a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:25:57 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Flow 'volume_create_manager' (a1b16a18-090a-441b-9c73-e498259378ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:25:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-cf688446-cdd6-4ea8-a93d-ebd3c3e5ead1 tempest-CinderUnicodeTest-2007885074 None] Created volume successfully. Nov 05 16:25:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-eb73c3dd-2874-417b-b916-9b968c09d43c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-eb73c3dd-2874-417b-b916-9b968c09d43c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-eb73c3dd-2874-417b-b916-9b968c09d43c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:25:58 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-eb73c3dd-2874-417b-b916-9b968c09d43c" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:25:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a0048-8cdc-47d1-a315-565bd4f04e84]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:58 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c Nov 05 16:25:58 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Creating offline snapshot 7e8e83a8-ff62-4154-9c45-79d8af320289 of volume 49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd32b2f-0c39-4258-9f83-328a6529ee06]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:59 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c" returned: 0 in 0.520s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:59 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c Nov 05 16:25:59 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:59 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 Nov 05 16:25:59 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:59 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-eb73c3dd-2874-417b-b916-9b968c09d43c" returned: 0 in 0.330s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-eb73c3dd-2874-417b-b916-9b968c09d43c" released by "delete_volume" :: held 0.944s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:25:59 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543" returned: 0 in 0.521s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:59 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 1G Nov 05 16:25:59 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Created reservations ['938d5543-c624-4127-bc3a-b757474ab97a', '4e24be5a-61d5-4ec6-ae7a-453d850cc273', 'c09c467d-c731-4c6c-8289-6c6395425d8e', 'b69c0924-2612-464c-bbd5-847f4a5e8a82'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:25:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:25:59 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:25:59 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:00 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.317s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:00 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ce597f8-22cb-497f-a98e-329a45b9c68b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-eb73c3dd-2874-417b-b916-9b968c09d43c-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:00 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 1G" returned: 0 in 0.656s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49fe3459-9085-463c-885c-b46f1a58d543 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:00 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49fe3459-9085-463c-885c-b46f1a58d543 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 Nov 05 16:26:00 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (76486c17-5c9e-4c33-99de-6b5fa3768df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec561313-28ad-48f5-9f56-c9ddbb18b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec561313-28ad-48f5-9f56-c9ddbb18b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189146655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e372a9-5151-473d-82df-0b80dfe81873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:00Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890cced5-7248-4c60-901f-2447700b78e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890cced5-7248-4c60-901f-2447700b78e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2baa8853-2fd6-43b6-9182-83c0bbe42565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2baa8853-2fd6-43b6-9182-83c0bbe42565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e372a9-5151-473d-82df-0b80dfe81873', 'volume_name': 'volume-b2e372a9-5151-473d-82df-0b80dfe81873', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1591a9b4-45fb-4392-97be-6270415b2266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1591a9b4-45fb-4392-97be-6270415b2266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09d884c-15eb-44c2-9f2c-92b84fb211c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:00 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Volume b2e372a9-5151-473d-82df-0b80dfe81873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e372a9-5151-473d-82df-0b80dfe81873', 'volume_size': 1} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:00 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49fe3459-9085-463c-885c-b46f1a58d543 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289" returned: 0 in 0.339s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:00 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 is being set with open permissions: ugo+rw Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:00 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 Nov 05 16:26:00 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:00 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289" returned: 0 in 0.273s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:00 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.info Nov 05 16:26:00 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:01 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.info" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:01 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.info is being set with open permissions: ugo+rw Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:01 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.info Nov 05 16:26:01 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:01 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.info" returned: 0 in 0.299s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.504s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189146655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e372a9-5151-473d-82df-0b80dfe81873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:00Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Creating volume b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:01 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:01 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 1073741824 Nov 05 16:26:01 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-25f801f5-f76c-4238-adda-4e819da00937 tempest-CinderUnicodeTest-2007885074 None] Create snapshot completed successfully Nov 05 16:26:02 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 1073741824" returned: 0 in 0.493s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:02 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 Nov 05 16:26:02 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "cinder-7e8e83a8-ff62-4154-9c45-79d8af320289-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-7e8e83a8-ff62-4154-9c45-79d8af320289-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "cinder-quobyte-49fe3459-9085-463c-885c-b46f1a58d543" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-49fe3459-9085-463c-885c-b46f1a58d543" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "cinder-quobyte-7e8e83a8-ff62-4154-9c45-79d8af320289" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-7e8e83a8-ff62-4154-9c45-79d8af320289" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Deleting offline snapshot 7e8e83a8-ff62-4154-9c45-79d8af320289 of volume 49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] snapshot_file for this snap is: volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:02 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d5db4f-5a43-47db-bfad-79b196339a3f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873" returned: 0 in 0.304s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09d884c-15eb-44c2-9f2c-92b84fb211c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e372a9-5151-473d-82df-0b80dfe81873', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a32b25-fa06-4ddd-8464-252627e2c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Flow 'volume_create_manager' (f1e033ac-dcbe-420c-9ee1-f762b2b8a51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8efe6dc-8e83-4161-b526-f09013baed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:02 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Volume volume-b2e372a9-5151-473d-82df-0b80dfe81873 (b2e372a9-5151-473d-82df-0b80dfe81873): created successfully Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a32b25-fa06-4ddd-8464-252627e2c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (76486c17-5c9e-4c33-99de-6b5fa3768df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8efe6dc-8e83-4161-b526-f09013baed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8020b3b5-4daa-49f4-9975-36a2a08f7aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda3b7b5d52d45149acf55fe92d82315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:02Z,use_quota=True,user_id='ff8096a44f104020ac96d9b843b4e24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:02 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 Nov 05 16:26:02 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28c5803-f9a5-4a65-86f2-11f28ebb705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28c5803-f9a5-4a65-86f2-11f28ebb705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d17911-6bd9-4d2f-9123-2d6376466b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.image.glance [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Creating Keystone auth plugin from conf {{(pid=86924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 16:26:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0e5595ae-c8a3-4fdc-bba6-5401d0617d2c tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d17911-6bd9-4d2f-9123-2d6376466b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8020b3b5-4daa-49f4-9975-36a2a08f7aea', 'volume_name': 'volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea', 'volume_size': 1, 'image_id': '0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be5eba6b1750f329b15d28cc26ae7851', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eda3b7b5d52d45149acf55fe92d82315', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd8c33c6ef6848e65531a509186cde34383804270e1fcde4cd31a6321f085e1a29aab00f06f1cae5f86f4e5980b72b724d04c966aec3d75c6c41344a4accc019', 'id': '0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'created_at': datetime.datetime(2026, 11, 5, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 26, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5/file', 'properties': {}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49eda3d1-4ea5-4547-a7d2-90d89d8abb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:02 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49eda3d1-4ea5-4547-a7d2-90d89d8abb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b940ad53-d134-4457-8586-da14390fcc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:02 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Volume 8020b3b5-4daa-49f4-9975-36a2a08f7aea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea', 'volume_size': 1, 'image_id': '0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be5eba6b1750f329b15d28cc26ae7851', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eda3b7b5d52d45149acf55fe92d82315', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd8c33c6ef6848e65531a509186cde34383804270e1fcde4cd31a6321f085e1a29aab00f06f1cae5f86f4e5980b72b724d04c966aec3d75c6c41344a4accc019', 'id': '0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'created_at': datetime.datetime(2026, 11, 5, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 26, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5/file', 'properties': {}}, 'image_service': } Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Trying to clone 8020b3b5-4daa-49f4-9975-36a2a08f7aea from image 0fde9e48-0cdb-425a-9aee-bee51fe583a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'metadata': {}}]). {{(pid=86924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49fe3459-9085-463c-885c-b46f1a58d543(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13b93f6-c789-46e4-ae02-1c0604b59497]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:760}} Nov 05 16:26:02 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Image download 0.00 MB at 0.00 MB/s Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[38be2797-136b-462b-bbb3-8825915b51cf]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:02 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 Nov 05 16:26:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:02 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:03 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD Nov 05 16:26:03 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:03 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543" returned: 0 in 0.507s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:03 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:03 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 Nov 05 16:26:03 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:03 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD Nov 05 16:26:03 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot daad3157-5936-42cd-add6-568f234a3af8 of volume b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d384a-0cd8-4cbb-9ef5-becf8c208c26]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:03 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:03 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD" returned: 1 in 0.450s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Temporary image 0fde9e48-0cdb-425a-9aee-bee51fe583a5 is fetched for user ff8096a44f104020ac96d9b843b4e24e. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1463}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289" returned: 0 in 0.505s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:03 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289 Nov 05 16:26:03 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[253dc769-c84f-44c1-ac19-dde9fed277d8]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:03 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 Nov 05 16:26:03 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:04 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD Nov 05 16:26:04 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:04 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543.7e8e83a8-ff62-4154-9c45-79d8af320289" returned: 0 in 0.276s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-7e8e83a8-ff62-4154-9c45-79d8af320289" released by "_delete_snapshot" :: held 1.887s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-49fe3459-9085-463c-885c-b46f1a58d543" released by "delete_snapshot" :: held 1.917s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:04 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873" returned: 0 in 0.414s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Created reservations ['74c44af0-3725-4cd1-a60f-0859e966478a', '31bccab7-2b1a-4b08-9d61-05ef1e82037b', 'bfc60428-00e4-4db4-a32a-6ba9f3da7f3e', 'c0e5bc70-9fd6-41de-af79-fe5b34f8ff79'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:04 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 1G Nov 05 16:26:04 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:04 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:04 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Delete snapshot completed successfully. Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-344c9e35-6409-4a50-beee-a80b7dafba58 tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-7e8e83a8-ff62-4154-9c45-79d8af320289-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "cinder-49fe3459-9085-463c-885c-b46f1a58d543-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-49fe3459-9085-463c-885c-b46f1a58d543-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:04 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD Nov 05 16:26:04 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "cinder-quobyte-49fe3459-9085-463c-885c-b46f1a58d543" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-49fe3459-9085-463c-885c-b46f1a58d543" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1782b7-6018-4ade-8527-63696ba91c3b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:04 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 Nov 05 16:26:04 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:04 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD" returned: 1 in 0.476s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:04 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 1G" returned: 0 in 0.555s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2e372a9-5151-473d-82df-0b80dfe81873 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:04 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2e372a9-5151-473d-82df-0b80dfe81873 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 Nov 05 16:26:04 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:05 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543" returned: 0 in 0.412s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:05 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543 Nov 05 16:26:05 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:05 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2e372a9-5151-473d-82df-0b80dfe81873 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8" returned: 0 in 0.331s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:05 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 is being set with open permissions: ugo+rw Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:05 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 Nov 05 16:26:05 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:05 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-49fe3459-9085-463c-885c-b46f1a58d543" returned: 0 in 0.281s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-49fe3459-9085-463c-885c-b46f1a58d543" released by "delete_volume" :: held 0.772s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Created reservations ['e8d82f80-e6bd-4b4f-b0ac-a8e93f575372', 'a330a1ca-e038-4ff5-a597-3940f7a322a3', '7a54b17c-04f2-4fec-8ab8-dd7eba489a6d', '65c8e304-c0c4-4a5c-95b6-b7fb5a333aeb'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:05 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8" returned: 0 in 0.279s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:05 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.info Nov 05 16:26:05 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:05 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:05 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "cinder-54a1620a-5ac6-4f81-a6fe-dc88101f0c84-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-54a1620a-5ac6-4f81-a6fe-dc88101f0c84-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:05 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.info" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:05 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.info is being set with open permissions: ugo+rw Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "cinder-quobyte-54a1620a-5ac6-4f81-a6fe-dc88101f0c84" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:05 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.info Nov 05 16:26:05 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-54a1620a-5ac6-4f81-a6fe-dc88101f0c84" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6afe6-f5a1-428a-8de4-534b4cfb95da]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:05 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.342s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:05 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Deleted volume successfully. Nov 05 16:26:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f4a4eb60-744e-4536-a057-657cdc892f4f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-49fe3459-9085-463c-885c-b46f1a58d543-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:05 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 Nov 05 16:26:05 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:06 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.info" returned: 0 in 0.352s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8020b3b5-4daa-49f4-9975-36a2a08f7aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda3b7b5d52d45149acf55fe92d82315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:02Z,use_quota=True,user_id='ff8096a44f104020ac96d9b843b4e24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Creating volume 8020b3b5-4daa-49f4-9975-36a2a08f7aea {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:06 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:06 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea 1073741824 Nov 05 16:26:06 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:06 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-109e291c-593b-4881-a2f7-8c6a2863cac2 tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:26:06 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84" returned: 0 in 0.435s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:06 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84 Nov 05 16:26:06 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:06 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-54a1620a-5ac6-4f81-a6fe-dc88101f0c84" returned: 0 in 0.309s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-quobyte-54a1620a-5ac6-4f81-a6fe-dc88101f0c84" released by "delete_volume" :: held 0.810s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Created reservations ['9915c276-4178-404c-8972-c2aaabe41238', '0b7f1123-76bb-41af-8726-30b823768d16', '2a12a594-fe9e-43ca-95e0-0f7a545d7eda', 'd00209de-5710-49d1-8396-ab97f7f59382'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:06 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea 1073741824" returned: 0 in 0.582s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:06 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:06 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:06 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea Nov 05 16:26:06 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-daad3157-5936-42cd-add6-568f234a3af8-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Lock "cinder-daad3157-5936-42cd-add6-568f234a3af8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-b2e372a9-5151-473d-82df-0b80dfe81873" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-b2e372a9-5151-473d-82df-0b80dfe81873" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-daad3157-5936-42cd-add6-568f234a3af8" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-daad3157-5936-42cd-add6-568f234a3af8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot daad3157-5936-42cd-add6-568f234a3af8 of volume b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:07 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03b9564-f60b-42d2-a885-c00a91cf0d22]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:07 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.437s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:07 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Deleted volume successfully. Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3f284387-a060-4566-9ebc-08c59dfd180f tempest-CinderUnicodeTest-2007885074 None] Lock "cinder-54a1620a-5ac6-4f81-a6fe-dc88101f0c84-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Attempting download of 0fde9e48-0cdb-425a-9aee-bee51fe583a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'metadata': {}}])) to volume 8020b3b5-4daa-49f4-9975-36a2a08f7aea. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa38d7-a4e0-4848-842e-d0a1e1059e7d]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fde9e48-0cdb-425a-9aee-bee51fe583a5_mt09vncj {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:07 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 Nov 05 16:26:07 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:07 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fde9e48-0cdb-425a-9aee-bee51fe583a5_mt09vncj Nov 05 16:26:07 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:07 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8" returned: 0 in 0.429s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2e372a9-5151-473d-82df-0b80dfe81873(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7c2c8-55b2-495e-91f4-7f51087dc4ae]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:07 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fde9e48-0cdb-425a-9aee-bee51fe583a5_mt09vncj" returned: 0 in 0.436s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fde9e48-0cdb-425a-9aee-bee51fe583a5_mt09vncj {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:07 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 Nov 05 16:26:07 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:07 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fde9e48-0cdb-425a-9aee-bee51fe583a5_mt09vncj Nov 05 16:26:07 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:08 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fde9e48-0cdb-425a-9aee-bee51fe583a5_mt09vncj" returned: 1 in 0.414s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fde9e48-0cdb-425a-9aee-bee51fe583a5_mt09vncj' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bbc1bb-90fb-4fdb-bdb0-68b4745461c9]: (4, 'raw') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:08 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873" returned: 0 in 0.536s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:08 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 Nov 05 16:26:08 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:08 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD Nov 05 16:26:08 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:08 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:08 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8" returned: 0 in 0.507s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:08 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8 Nov 05 16:26:08 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:08 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD Nov 05 16:26:08 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:09 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873.daad3157-5936-42cd-add6-568f234a3af8" returned: 0 in 0.312s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:09 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] 0fde9e48-0cdb-425a-9aee-bee51fe583a5 was raw, converting to qcow2 {{(pid=86924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1152}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:09 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea Nov 05 16:26:09 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-daad3157-5936-42cd-add6-568f234a3af8" released by "_delete_snapshot" :: held 2.008s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-b2e372a9-5151-473d-82df-0b80dfe81873" released by "delete_snapshot" :: held 2.043s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Created reservations ['965c67e1-27b7-417f-8a36-3ba20820ae1d', '577169e2-d467-4502-81b1-9d0e51befc4e', '0b3ffea7-ed75-4bea-8b24-6e5cb0a9a741', 'b820951e-7c19-4f79-9f25-a189869b515c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:09 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-87073187-b941-4ed5-8ea9-64b4e1c82fbe tempest-ProjectMemberTests-1442965469 None] Lock "cinder-daad3157-5936-42cd-add6-568f234a3af8-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:09 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea" returned: 0 in 0.562s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fde9e48-0cdb-425a-9aee-bee51fe583a5_6rca2jn2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:26:09 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:09 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea 1G Nov 05 16:26:09 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Flow 'volume_create_manager' (fef3142f-ddd1-4b61-b6dc-38007f34f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a42db0f-d720-408f-9499-532c45a15d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a42db0f-d720-408f-9499-532c45a15d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856127349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9112e23-64f2-4d4a-a245-e980cb8179c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9f01c76a644b3a7b785366f60eb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:10Z,use_quota=True,user_id='40e1891771ff41189e5a2f214a040e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9fd7f9-59e8-4eb8-b097-3d55cc6c0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9fd7f9-59e8-4eb8-b097-3d55cc6c0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f8d37-71a4-4ae6-855d-085cd9d2619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9f8d37-71a4-4ae6-855d-085cd9d2619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9112e23-64f2-4d4a-a245-e980cb8179c0', 'volume_name': 'volume-f9112e23-64f2-4d4a-a245-e980cb8179c0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68eb01e-18c5-45da-bf3e-c540352ae41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68eb01e-18c5-45da-bf3e-c540352ae41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97843b2a-cb8d-4842-b938-446b9cc195d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:09 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Volume f9112e23-64f2-4d4a-a245-e980cb8179c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9112e23-64f2-4d4a-a245-e980cb8179c0', 'volume_size': 1} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-856127349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9112e23-64f2-4d4a-a245-e980cb8179c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9f01c76a644b3a7b785366f60eb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:10Z,use_quota=True,user_id='40e1891771ff41189e5a2f214a040e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Creating volume f9112e23-64f2-4d4a-a245-e980cb8179c0 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:09 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:10 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:10 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 1073741824 Nov 05 16:26:10 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:10 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea 1G" returned: 0 in 0.422s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Downloaded image 0fde9e48-0cdb-425a-9aee-bee51fe583a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'metadata': {}}])) to volume 8020b3b5-4daa-49f4-9975-36a2a08f7aea successfully. {{(pid=86924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Temporary image 0fde9e48-0cdb-425a-9aee-bee51fe583a5 for user ff8096a44f104020ac96d9b843b4e24e is deleted. {{(pid=86924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1467}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.volume_utils [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Marking volume 8020b3b5-4daa-49f4-9975-36a2a08f7aea as bootable. {{(pid=86924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Copying metadata from image 0fde9e48-0cdb-425a-9aee-bee51fe583a5 to 8020b3b5-4daa-49f4-9975-36a2a08f7aea. {{(pid=86924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Creating volume glance metadata for volume 8020b3b5-4daa-49f4-9975-36a2a08f7aea backed by image 0fde9e48-0cdb-425a-9aee-bee51fe583a5 with: {'image_id': '0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'be5eba6b1750f329b15d28cc26ae7851', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b940ad53-d134-4457-8586-da14390fcc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea', 'volume_size': 1, 'image_id': '0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be5eba6b1750f329b15d28cc26ae7851', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eda3b7b5d52d45149acf55fe92d82315', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd8c33c6ef6848e65531a509186cde34383804270e1fcde4cd31a6321f085e1a29aab00f06f1cae5f86f4e5980b72b724d04c966aec3d75c6c41344a4accc019', 'id': '0fde9e48-0cdb-425a-9aee-bee51fe583a5', 'created_at': datetime.datetime(2026, 11, 5, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 15, 26, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fde9e48-0cdb-425a-9aee-bee51fe583a5/file', 'properties': {}}, 'image_service': }' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aacb494-2bff-43df-8399-015f81a3134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:10 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Volume volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea (8020b3b5-4daa-49f4-9975-36a2a08f7aea): created successfully Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aacb494-2bff-43df-8399-015f81a3134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Flow 'volume_create_manager' (f1e033ac-dcbe-420c-9ee1-f762b2b8a51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:10 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-459529d9-67a5-4dc5-abd8-8a7e944ca216 tempest-VolumeImageDependencyTests-1733102996 None] Created volume successfully. Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-b2e372a9-5151-473d-82df-0b80dfe81873-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Lock "cinder-b2e372a9-5151-473d-82df-0b80dfe81873-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-b2e372a9-5151-473d-82df-0b80dfe81873" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-b2e372a9-5151-473d-82df-0b80dfe81873" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c38be5-f321-4715-98a5-34c87ca4c08b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:10 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 1073741824" returned: 0 in 0.540s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:10 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 Nov 05 16:26:10 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:10 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 Nov 05 16:26:10 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:10 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0" returned: 0 in 0.299s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97843b2a-cb8d-4842-b938-446b9cc195d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9112e23-64f2-4d4a-a245-e980cb8179c0', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288c1c89-db9b-4c38-9b24-f88c47c20e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:10 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873" returned: 0 in 0.440s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:10 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Volume volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 (f9112e23-64f2-4d4a-a245-e980cb8179c0): created successfully Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288c1c89-db9b-4c38-9b24-f88c47c20e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:10 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Flow 'volume_create_manager' (fef3142f-ddd1-4b61-b6dc-38007f34f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:10 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873 Nov 05 16:26:10 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:10 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d30f3c56-6852-409b-9577-efa28bf851f9 tempest-ProjectReaderTests-1345577862 None] Created volume successfully. Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Acquiring lock "cinder-8020b3b5-4daa-49f4-9975-36a2a08f7aea-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Lock "cinder-8020b3b5-4daa-49f4-9975-36a2a08f7aea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=205,cinder:UPDATE=306,cinder:INSERT=81,cinder:DELETE=32 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Acquiring lock "cinder-quobyte-8020b3b5-4daa-49f4-9975-36a2a08f7aea" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Lock "cinder-quobyte-8020b3b5-4daa-49f4-9975-36a2a08f7aea" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:11 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b2e372a9-5151-473d-82df-0b80dfe81873" returned: 0 in 0.307s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08068e9-d0ab-439e-88a2-f79916c56c44]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-b2e372a9-5151-473d-82df-0b80dfe81873" released by "delete_volume" :: held 0.823s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=248,cinder:INSERT=81,cinder:UPDATE=296,cinder:DELETE=22 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Created reservations ['c07eaf93-6783-484b-b04c-15da4071e2d9', '70195ec7-e759-490c-8410-b55309fab546', 'd75cf073-a35e-4ad6-a177-6aea9b375027', '1966974a-5ea7-4a75-93bd-359b57d64f39'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:11 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea Nov 05 16:26:11 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:11 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:11 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:11 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea" returned: 0 in 0.438s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:11 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.296s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:11 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:26:11 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea Nov 05 16:26:11 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:11 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1cb131de-9d27-4fc5-8802-505feeaff2ed tempest-ProjectMemberTests-1442965469 None] Lock "cinder-b2e372a9-5151-473d-82df-0b80dfe81873-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:12 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-8020b3b5-4daa-49f4-9975-36a2a08f7aea" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Lock "cinder-quobyte-8020b3b5-4daa-49f4-9975-36a2a08f7aea" released by "delete_volume" :: held 0.868s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Created reservations ['1aed2c0b-a2ea-420d-bee8-97700dfd7050', '4066578f-9478-49df-901b-cc1a1b874cc5', '7df96cc5-c96d-4c03-9d37-23148d4c79f8', '51059b97-47b4-424c-927d-afbe1ef52388'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (b6e62e18-09af-435f-bc70-98ee50f20441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309f6beb-83ce-40a9-bbb7-a493407461dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309f6beb-83ce-40a9-bbb7-a493407461dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961113706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6140407f-6d5e-4e86-8401-b549f977b51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:12Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc6dc40-3f03-4793-b0b2-d54ef1da45b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc6dc40-3f03-4793-b0b2-d54ef1da45b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdf7d75-3afe-4a51-837f-cfa9ff4d1509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdf7d75-3afe-4a51-837f-cfa9ff4d1509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6140407f-6d5e-4e86-8401-b549f977b51d', 'volume_name': 'volume-6140407f-6d5e-4e86-8401-b549f977b51d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560f00eb-5ff2-46f2-a425-31a409620528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560f00eb-5ff2-46f2-a425-31a409620528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf9352e-46b4-4dc9-bbe1-0b4d9248e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:12 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Volume 6140407f-6d5e-4e86-8401-b549f977b51d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6140407f-6d5e-4e86-8401-b549f977b51d', 'volume_size': 1} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961113706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6140407f-6d5e-4e86-8401-b549f977b51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:12Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Creating volume 6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:12 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Acquiring lock "cinder-f9112e23-64f2-4d4a-a245-e980cb8179c0-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:12 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d 1073741824 Nov 05 16:26:12 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Lock "cinder-f9112e23-64f2-4d4a-a245-e980cb8179c0-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:12 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:12 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Acquiring lock "cinder-quobyte-f9112e23-64f2-4d4a-a245-e980cb8179c0" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Lock "cinder-quobyte-f9112e23-64f2-4d4a-a245-e980cb8179c0" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49f315b-bee5-4ad0-99c1-b533b679fbf2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:12 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.326s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Deleted volume successfully. Nov 05 16:26:12 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 Nov 05 16:26:12 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f1f38214-0fdc-48a2-9d9e-e2375d10f122 tempest-VolumeImageDependencyTests-1733102996 None] Lock "cinder-8020b3b5-4daa-49f4-9975-36a2a08f7aea-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:12 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:13 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d 1073741824" returned: 0 in 0.737s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:13 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0" returned: 0 in 0.540s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:13 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d Nov 05 16:26:13 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:13 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0 Nov 05 16:26:13 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:13 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d" returned: 0 in 0.312s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:13 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf9352e-46b4-4dc9-bbe1-0b4d9248e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6140407f-6d5e-4e86-8401-b549f977b51d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9306ad46-6dfb-4366-b532-f26a60feaf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f9112e23-64f2-4d4a-a245-e980cb8179c0" returned: 0 in 0.323s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Lock "cinder-quobyte-f9112e23-64f2-4d4a-a245-e980cb8179c0" released by "delete_volume" :: held 0.957s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:13 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Volume volume-6140407f-6d5e-4e86-8401-b549f977b51d (6140407f-6d5e-4e86-8401-b549f977b51d): created successfully Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9306ad46-6dfb-4366-b532-f26a60feaf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (b6e62e18-09af-435f-bc70-98ee50f20441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b69a3890-9561-499a-b951-59f7e99b2c16 tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Created reservations ['96e6c84b-baa0-4c4a-84c1-ba242f780b05', 'fe09a7fa-b265-492a-9eeb-1dabb5b76f55', 'a83e503a-d2b7-4344-8c14-ea323395a974', 'd2ff8b37-0527-43b5-a74c-0b6ee2e3e6e8'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:13 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:13 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:13 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.296s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:13 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:13 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Deleted volume successfully. Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1286a46d-63c2-4cb1-9819-a665bb4d29df tempest-ProjectReaderTests-1345577862 None] Lock "cinder-f9112e23-64f2-4d4a-a245-e980cb8179c0-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot a889dcc8-3879-48ff-a3c1-f53b03453555 of volume 6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e18bfd-ec40-4136-bb24-36902ad0b4d6]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:14 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d Nov 05 16:26:14 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:14 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d" returned: 0 in 0.468s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:15 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 1G Nov 05 16:26:15 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Flow 'volume_create_manager' (dc153e91-cf08-4e1e-bc16-db29bf427e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b118928-a9f6-4460-8b15-b2399eae9774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b118928-a9f6-4460-8b15-b2399eae9774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121437870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052b4379-4cbf-491f-8dce-feeda8a1f162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9f01c76a644b3a7b785366f60eb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:15Z,use_quota=True,user_id='40e1891771ff41189e5a2f214a040e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26ac2a0-f065-4ee9-8f7b-a989432803b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26ac2a0-f065-4ee9-8f7b-a989432803b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56074a9b-2e81-4c2f-815b-25316597e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56074a9b-2e81-4c2f-815b-25316597e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052b4379-4cbf-491f-8dce-feeda8a1f162', 'volume_name': 'volume-052b4379-4cbf-491f-8dce-feeda8a1f162', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aea6da-92b7-4ef2-a716-86559e3b5ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aea6da-92b7-4ef2-a716-86559e3b5ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4674c9a-4569-471a-a2de-4078590f2995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Volume 052b4379-4cbf-491f-8dce-feeda8a1f162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052b4379-4cbf-491f-8dce-feeda8a1f162', 'volume_size': 1} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:15 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 1G" returned: 0 in 0.535s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6140407f-6d5e-4e86-8401-b549f977b51d -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:15 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6140407f-6d5e-4e86-8401-b549f977b51d -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 Nov 05 16:26:15 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:15 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6140407f-6d5e-4e86-8401-b549f977b51d -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555" returned: 0 in 0.333s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:15 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 is being set with open permissions: ugo+rw Nov 05 16:26:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:15 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 Nov 05 16:26:15 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:16 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555" returned: 0 in 0.272s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:16 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.info Nov 05 16:26:16 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:16 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.info" returned: 0 in 0.329s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:16 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.info is being set with open permissions: ugo+rw Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:16 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.info Nov 05 16:26:16 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:16 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.info" returned: 0 in 0.291s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121437870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052b4379-4cbf-491f-8dce-feeda8a1f162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9f01c76a644b3a7b785366f60eb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:15Z,use_quota=True,user_id='40e1891771ff41189e5a2f214a040e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Creating volume 052b4379-4cbf-491f-8dce-feeda8a1f162 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:16 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:16 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 1073741824 Nov 05 16:26:16 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-488eff8c-711f-4cb9-bc5d-3d56ef0a31fa tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:26:17 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 1073741824" returned: 0 in 0.464s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:17 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 Nov 05 16:26:17 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:17 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162" returned: 0 in 0.256s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4674c9a-4569-471a-a2de-4078590f2995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052b4379-4cbf-491f-8dce-feeda8a1f162', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765acd6d-33fc-49ca-8c30-edb4071398d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:17 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Volume volume-052b4379-4cbf-491f-8dce-feeda8a1f162 (052b4379-4cbf-491f-8dce-feeda8a1f162): created successfully Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765acd6d-33fc-49ca-8c30-edb4071398d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Flow 'volume_create_manager' (dc153e91-cf08-4e1e-bc16-db29bf427e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8fc78e44-fb2c-45ba-9aff-a7f927abc35a tempest-ProjectReaderTests-1345577862 None] Created volume successfully. Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-a889dcc8-3879-48ff-a3c1-f53b03453555-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-a889dcc8-3879-48ff-a3c1-f53b03453555-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-6140407f-6d5e-4e86-8401-b549f977b51d" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-6140407f-6d5e-4e86-8401-b549f977b51d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-a889dcc8-3879-48ff-a3c1-f53b03453555" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-a889dcc8-3879-48ff-a3c1-f53b03453555" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot a889dcc8-3879-48ff-a3c1-f53b03453555 of volume 6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c63c435-cf1a-4d70-8791-a735ceabe4da]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:17 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 Nov 05 16:26:17 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:18 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555" returned: 0 in 0.409s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6140407f-6d5e-4e86-8401-b549f977b51d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[29505a3a-b6cf-40e3-b1b6-616ac9701525]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:18 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d Nov 05 16:26:18 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Acquiring lock "cinder-052b4379-4cbf-491f-8dce-feeda8a1f162-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Lock "cinder-052b4379-4cbf-491f-8dce-feeda8a1f162-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Acquiring lock "cinder-quobyte-052b4379-4cbf-491f-8dce-feeda8a1f162" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Lock "cinder-quobyte-052b4379-4cbf-491f-8dce-feeda8a1f162" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce447b7-37d4-4457-b7f5-6b453e8de8f7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:18 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d" returned: 0 in 0.460s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:18 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 Nov 05 16:26:18 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:18 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 Nov 05 16:26:18 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:19 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555" returned: 0 in 0.372s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:19 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162" returned: 0 in 0.451s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:19 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555 Nov 05 16:26:19 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:19 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162 Nov 05 16:26:19 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:19 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d.a889dcc8-3879-48ff-a3c1-f53b03453555" returned: 0 in 0.317s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:19 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-052b4379-4cbf-491f-8dce-feeda8a1f162" returned: 0 in 0.314s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-a889dcc8-3879-48ff-a3c1-f53b03453555" released by "_delete_snapshot" :: held 1.691s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-6140407f-6d5e-4e86-8401-b549f977b51d" released by "delete_snapshot" :: held 1.723s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Lock "cinder-quobyte-052b4379-4cbf-491f-8dce-feeda8a1f162" released by "delete_volume" :: held 0.840s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Created reservations ['646c1b26-3035-45c7-b9f4-35f1a98baddb', '92bacc6c-e6fc-4156-b58a-bf0256a35350', '75e1957e-5e1f-450f-bb14-d604b172c206', 'a5e48a92-db11-4a86-8d6a-8f51901e20a0'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Created reservations ['d1d6563b-75fd-4575-bc1b-bb67c7426a10', '4ac7e467-acef-4749-9ef9-0f0d30698db5', 'ff085b05-2b54-4c44-9236-ae14039d6b6e', '50bd56b7-a062-465a-9831-912ecfd97367'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:19 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:19 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-6bf61b89-18e6-4dc8-a780-4e3b8111dd7b tempest-ProjectMemberTests-1442965469 None] Lock "cinder-a889dcc8-3879-48ff-a3c1-f53b03453555-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:19 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-6140407f-6d5e-4e86-8401-b549f977b51d-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.304s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Deleted volume successfully. Nov 05 16:26:19 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-6140407f-6d5e-4e86-8401-b549f977b51d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-73926fe8-55ce-42b4-98b8-cdb46dc4c8b6 tempest-ProjectReaderTests-1345577862 None] Lock "cinder-052b4379-4cbf-491f-8dce-feeda8a1f162-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-6140407f-6d5e-4e86-8401-b549f977b51d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-6140407f-6d5e-4e86-8401-b549f977b51d" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc500894-a2cd-445d-b15e-5284af81662d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:20 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d Nov 05 16:26:20 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:20 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d" returned: 0 in 0.470s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:20 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d Nov 05 16:26:20 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:20 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6140407f-6d5e-4e86-8401-b549f977b51d" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-6140407f-6d5e-4e86-8401-b549f977b51d" released by "delete_volume" :: held 0.862s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:20 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Created reservations ['20ca4188-e70b-4e1d-b6f1-5fd0dd049dac', 'f479c394-ae00-40c3-ba84-21f341d64cfb', 'c5631c55-6f48-414f-bcf6-b842ec6332f8', 'ab8e0401-23ba-40ae-ba5d-6ab5735b05ec'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:21 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:21 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:21 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.371s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-04b2e29a-940f-47ad-b20e-47f8ed6e9436 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-6140407f-6d5e-4e86-8401-b549f977b51d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (6517c159-84ae-43ea-bccf-03aa4ff27870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670d3799-4785-4d03-85a2-9512ac3f4383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670d3799-4785-4d03-85a2-9512ac3f4383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-612790699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea91fb7-5f65-4317-9ac9-cab2af23e5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:22Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894a6545-1a4a-400d-b806-571b983974e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894a6545-1a4a-400d-b806-571b983974e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa21fbc-b095-490f-a293-b89ed6b2dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa21fbc-b095-490f-a293-b89ed6b2dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea91fb7-5f65-4317-9ac9-cab2af23e5cd', 'volume_name': 'volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd0dd57-2bdb-43ac-92fa-50c31f458b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd0dd57-2bdb-43ac-92fa-50c31f458b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123989d0-f41d-46a9-a8c8-280b36190ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:21 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Volume 9ea91fb7-5f65-4317-9ac9-cab2af23e5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd', 'volume_size': 1} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-612790699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea91fb7-5f65-4317-9ac9-cab2af23e5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:22Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Creating volume 9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:21 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:21 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd 1073741824 Nov 05 16:26:21 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:22 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd 1073741824" returned: 0 in 0.535s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:22 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd Nov 05 16:26:22 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:22 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" returned: 0 in 0.270s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123989d0-f41d-46a9-a8c8-280b36190ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78982339-0e2d-4cc3-a230-8f4db7e3fde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:22 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Volume volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd (9ea91fb7-5f65-4317-9ac9-cab2af23e5cd): created successfully Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78982339-0e2d-4cc3-a230-8f4db7e3fde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:22 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (6517c159-84ae-43ea-bccf-03aa4ff27870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:22 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ef1f305a-695e-4b1e-8c2b-561448310072 tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot c22e1d62-2cb1-4e6a-be20-fad0b72aa65a of volume 9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcd1ac2-86d7-4658-9485-b173e7e5bdbd]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:24 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd Nov 05 16:26:24 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:24 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:24 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a 1G Nov 05 16:26:24 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:24 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a 1G" returned: 0 in 0.446s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:24 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a Nov 05 16:26:24 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:25 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" returned: 0 in 0.298s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:25 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a is being set with open permissions: ugo+rw Nov 05 16:26:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:25 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a Nov 05 16:26:25 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:25 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:25 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.info Nov 05 16:26:25 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:25 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.info" returned: 0 in 0.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:25 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.info is being set with open permissions: ugo+rw Nov 05 16:26:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:25 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.info Nov 05 16:26:25 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:26 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.info" returned: 0 in 0.253s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-527bbf67-ac65-456f-addb-655d63e7d3d4 tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-c22e1d62-2cb1-4e6a-be20-fad0b72aa65a-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-c22e1d62-2cb1-4e6a-be20-fad0b72aa65a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot c22e1d62-2cb1-4e6a-be20-fad0b72aa65a of volume 9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dccb7e-71b3-4a21-a37e-17c99156c6d8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:27 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a Nov 05 16:26:27 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:27 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" returned: 0 in 0.363s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9b31f3-d180-45e3-b651-e6f21e4b5a00]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:27 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd Nov 05 16:26:27 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:28 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" returned: 0 in 0.379s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:28 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a Nov 05 16:26:28 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:28 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" returned: 0 in 0.345s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:28 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a Nov 05 16:26:28 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:28 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd.c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" returned: 0 in 0.256s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-c22e1d62-2cb1-4e6a-be20-fad0b72aa65a" released by "_delete_snapshot" :: held 1.456s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" released by "delete_snapshot" :: held 1.479s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Created reservations ['ea235212-5c7e-4253-adcc-3428234653fb', '452b9661-b5ab-4785-9e22-9def0fb004e6', '4c967daa-51fe-4b3b-b0c6-66d364e15fbb', '20f06eb7-c1d7-40a3-a9d5-e6b0c73095cc'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:26:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-cee9b92f-93ce-4689-89a3-a30a656a7cf7 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-c22e1d62-2cb1-4e6a-be20-fad0b72aa65a-delete_snapshot" released by "delete_snapshot" :: held 1.620s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" acquired by "delete_volume" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b9e48-45d0-4483-9d35-3923f25a2a59]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (e284b756-5aa0-4c8d-9478-e044838acb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f06025-ca20-4a31-bbec-f05c042bfb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f06025-ca20-4a31-bbec-f05c042bfb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034751758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b21bb23-1be4-41fe-b5a1-8626812c005d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:30Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5641ca66-ae83-420d-b666-cf92311db278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5641ca66-ae83-420d-b666-cf92311db278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885d1873-45fa-415d-a288-8a7da6fc5119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885d1873-45fa-415d-a288-8a7da6fc5119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b21bb23-1be4-41fe-b5a1-8626812c005d', 'volume_name': 'volume-6b21bb23-1be4-41fe-b5a1-8626812c005d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f57eac-a7ea-4781-8b75-964b4baea883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f57eac-a7ea-4781-8b75-964b4baea883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba0c018-8cc7-4d10-bb75-09a426d5b81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:29 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Volume 6b21bb23-1be4-41fe-b5a1-8626812c005d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b21bb23-1be4-41fe-b5a1-8626812c005d', 'volume_size': 1} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034751758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b21bb23-1be4-41fe-b5a1-8626812c005d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:30Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Creating volume 6b21bb23-1be4-41fe-b5a1-8626812c005d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:29 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd Nov 05 16:26:29 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:29 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:29 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d 1073741824 Nov 05 16:26:29 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:29 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" returned: 0 in 0.380s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:29 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd Nov 05 16:26:29 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:30 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d 1073741824" returned: 0 in 0.427s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:30 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d Nov 05 16:26:30 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:30 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" returned: 0 in 0.277s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd" released by "delete_volume" :: held 0.729s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Created reservations ['01853ee0-85ec-4b78-a970-f9b3fdd6fcfa', '2708c7fb-2fc7-48a6-bb86-6a11f95d9b97', '021875ba-e02d-4c5b-bb20-31ffef156249', 'c73c5aeb-3c84-4a7c-a518-84ee2cace45d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:30 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:30 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:30 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d" returned: 0 in 0.262s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba0c018-8cc7-4d10-bb75-09a426d5b81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b21bb23-1be4-41fe-b5a1-8626812c005d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ec3c3f-65cb-47a2-aa84-fc9bef4740d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:30 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Volume volume-6b21bb23-1be4-41fe-b5a1-8626812c005d (6b21bb23-1be4-41fe-b5a1-8626812c005d): created successfully Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ec3c3f-65cb-47a2-aa84-fc9bef4740d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (e284b756-5aa0-4c8d-9478-e044838acb50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-36138fe8-c0be-4f56-ab78-b20b2893da88 tempest-ProjectReaderTests-2018227741 None] Created volume successfully. Nov 05 16:26:30 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-db1131fe-c066-4408-a30a-76d650848f63 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-9ea91fb7-5f65-4317-9ac9-cab2af23e5cd-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-6b21bb23-1be4-41fe-b5a1-8626812c005d-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-6b21bb23-1be4-41fe-b5a1-8626812c005d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-quobyte-6b21bb23-1be4-41fe-b5a1-8626812c005d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-6b21bb23-1be4-41fe-b5a1-8626812c005d" acquired by "delete_volume" :: waited 0.022s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[67249755-9a19-45de-931a-d2513a703e8b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:31 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d Nov 05 16:26:31 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (8ef02167-e2b5-4e22-9ab4-d4aed3dfe495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a423448a-26da-4764-be9a-4b2529fa7c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a423448a-26da-4764-be9a-4b2529fa7c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782494998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f8598d-5073-4898-8e6c-2a534e563a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:31Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b338b5-caa2-47f5-b82a-fece396366aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b338b5-caa2-47f5-b82a-fece396366aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ff39d-ee70-49aa-afcf-541d9fbd63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ff39d-ee70-49aa-afcf-541d9fbd63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f8598d-5073-4898-8e6c-2a534e563a18', 'volume_name': 'volume-34f8598d-5073-4898-8e6c-2a534e563a18', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89267a2-b4dc-41fa-a411-d1be949279bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89267a2-b4dc-41fa-a411-d1be949279bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d5d9b6-1fb8-494f-96da-f181673c6032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Volume 34f8598d-5073-4898-8e6c-2a534e563a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f8598d-5073-4898-8e6c-2a534e563a18', 'volume_size': 1} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782494998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f8598d-5073-4898-8e6c-2a534e563a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:31Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Creating volume 34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:31 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:31 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 1073741824 Nov 05 16:26:31 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:31 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:31 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d Nov 05 16:26:31 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:31 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-6b21bb23-1be4-41fe-b5a1-8626812c005d" returned: 0 in 0.280s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-6b21bb23-1be4-41fe-b5a1-8626812c005d" released by "delete_volume" :: held 0.718s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Created reservations ['0b6fe6fb-699f-49a8-ac41-d0b0d1b85d8f', 'be34fe6f-f5c6-4869-88fd-b0dfd159a9cb', '34230a60-b8ac-4ae3-a95e-58215f393e74', '59d38d05-23b3-4f4f-8337-99c5580bc2de'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:31 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 1073741824" returned: 0 in 0.430s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:31 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 Nov 05 16:26:31 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:31 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:31 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:31 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18" returned: 0 in 0.261s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d5d9b6-1fb8-494f-96da-f181673c6032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f8598d-5073-4898-8e6c-2a534e563a18', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18294b5d-1509-4e1d-9284-ca04c614b9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:31 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Volume volume-34f8598d-5073-4898-8e6c-2a534e563a18 (34f8598d-5073-4898-8e6c-2a534e563a18): created successfully Nov 05 16:26:31 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18294b5d-1509-4e1d-9284-ca04c614b9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (8ef02167-e2b5-4e22-9ab4-d4aed3dfe495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:32 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.270s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Deleted volume successfully. Nov 05 16:26:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3e21b61f-a140-4df9-9f38-4b6c3a6d0c3a tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-36bb4542-8f0b-4175-9a47-dd0b62e8e6a7 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-6b21bb23-1be4-41fe-b5a1-8626812c005d-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (562f2481-6557-487c-92ec-cb5fcc6b4182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d499d186-b17e-4f67-9ecf-2a1faa77719e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot d3c8e6ca-e32f-4680-9743-a332303cf988 of volume 34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d499d186-b17e-4f67-9ecf-2a1faa77719e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138043976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914fad0a-3e60-4271-b513-483820e50182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:32Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8fe7e1-6e1c-4a98-a567-dd8753e8f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8fe7e1-6e1c-4a98-a567-dd8753e8f46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58585b0e-f0fc-4468-9459-b9263197a976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58585b0e-f0fc-4468-9459-b9263197a976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914fad0a-3e60-4271-b513-483820e50182', 'volume_name': 'volume-914fad0a-3e60-4271-b513-483820e50182', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fff5014-4894-4bf9-aff2-407428e111eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fff5014-4894-4bf9-aff2-407428e111eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b86e8b-6263-454c-a728-4b3b13670153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:32 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Volume 914fad0a-3e60-4271-b513-483820e50182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914fad0a-3e60-4271-b513-483820e50182', 'volume_size': 1} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eb6dc6-2d9d-4d43-8912-08365f9f295f]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:32 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 Nov 05 16:26:32 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:32 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:32 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 1G Nov 05 16:26:32 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:33 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 1G" returned: 0 in 0.385s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f8598d-5073-4898-8e6c-2a534e563a18 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:33 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f8598d-5073-4898-8e6c-2a534e563a18 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 Nov 05 16:26:33 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:33 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34f8598d-5073-4898-8e6c-2a534e563a18 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988" returned: 0 in 0.279s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:33 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 is being set with open permissions: ugo+rw Nov 05 16:26:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:33 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 Nov 05 16:26:33 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:33 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:33 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.info Nov 05 16:26:33 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:34 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.info" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:34 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.info is being set with open permissions: ugo+rw Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:34 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.info Nov 05 16:26:34 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:34 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.info" returned: 0 in 0.233s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138043976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914fad0a-3e60-4271-b513-483820e50182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:32Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Creating volume 914fad0a-3e60-4271-b513-483820e50182 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:34 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:34 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 1073741824 Nov 05 16:26:34 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:34 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-517742be-d0b8-47a5-99a9-c2879d1e1bb5 tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:26:34 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 1073741824" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:34 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 Nov 05 16:26:34 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:35 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b86e8b-6263-454c-a728-4b3b13670153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914fad0a-3e60-4271-b513-483820e50182', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0734009c-9d74-4880-b6b4-e6b6e8a52dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:35 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Volume volume-914fad0a-3e60-4271-b513-483820e50182 (914fad0a-3e60-4271-b513-483820e50182): created successfully Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0734009c-9d74-4880-b6b4-e6b6e8a52dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (562f2481-6557-487c-92ec-cb5fcc6b4182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-aaa69fe3-6df9-4afe-b7fe-3170fe2e7533 tempest-ProjectReaderTests-2018227741 None] Created volume successfully. Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-d3c8e6ca-e32f-4680-9743-a332303cf988-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-d3c8e6ca-e32f-4680-9743-a332303cf988-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-34f8598d-5073-4898-8e6c-2a534e563a18" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-34f8598d-5073-4898-8e6c-2a534e563a18" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-d3c8e6ca-e32f-4680-9743-a332303cf988" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-d3c8e6ca-e32f-4680-9743-a332303cf988" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot d3c8e6ca-e32f-4680-9743-a332303cf988 of volume 34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-914fad0a-3e60-4271-b513-483820e50182-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca0d58-fc0e-4325-b3b3-01a07b751d96]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Lock "cinder-914fad0a-3e60-4271-b513-483820e50182-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-quobyte-914fad0a-3e60-4271-b513-483820e50182" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-914fad0a-3e60-4271-b513-483820e50182" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5251938-dac2-4a1f-b0f7-c953146ab5d2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:35 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 Nov 05 16:26:35 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:35 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 Nov 05 16:26:35 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:35 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988" returned: 0 in 0.371s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34f8598d-5073-4898-8e6c-2a534e563a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c856ff56-972e-4906-95ca-eff9649ba91d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:36 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:36 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 Nov 05 16:26:36 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:36 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182 Nov 05 16:26:36 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:36 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-914fad0a-3e60-4271-b513-483820e50182" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-914fad0a-3e60-4271-b513-483820e50182" released by "delete_volume" :: held 0.690s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:36 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:36 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 Nov 05 16:26:36 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Created reservations ['78a2e542-bd85-457b-b547-05f1ccd3fe6b', '561b762c-e532-407b-82b9-fa12b2668e6e', '8931f817-f4fa-43c0-bf3f-400df28dcae4', '4ef6645b-b6b0-47f8-a1d1-2d390c9ab1f3'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:36 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:36 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:36 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:36 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:36 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Deleted volume successfully. Nov 05 16:26:36 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988 Nov 05 16:26:36 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-e822bac2-af8c-4330-978b-83c1059854cf tempest-ProjectReaderTests-2018227741 None] Lock "cinder-914fad0a-3e60-4271-b513-483820e50182-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:37 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18.d3c8e6ca-e32f-4680-9743-a332303cf988" returned: 0 in 0.284s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-d3c8e6ca-e32f-4680-9743-a332303cf988" released by "_delete_snapshot" :: held 1.534s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-34f8598d-5073-4898-8e6c-2a534e563a18" released by "delete_snapshot" :: held 1.560s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Created reservations ['bfaa1e7a-29a2-4a36-b656-ae314268640c', '679bc6bf-0e29-4c8b-af8b-2044f9562c88', '9c1bf414-ca04-4a2b-9bbc-12c5e5513ba9', 'f15527bf-4174-4ccd-b3b7-7d50677a889e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (493c570c-22ef-45ed-b74f-66cde67ff3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924c846a-c2d0-4afe-9869-a751f00e2eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924c846a-c2d0-4afe-9869-a751f00e2eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592612856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3479006-e627-4b70-8ed6-4396614b41e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:37Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166452f8-8877-44ee-bda9-7241468c11cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166452f8-8877-44ee-bda9-7241468c11cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29921b92-002c-4fb6-bdeb-1cae49d01f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29921b92-002c-4fb6-bdeb-1cae49d01f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3479006-e627-4b70-8ed6-4396614b41e2', 'volume_name': 'volume-d3479006-e627-4b70-8ed6-4396614b41e2', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d26fc7-7301-40d8-8988-bf8ce8dabf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d26fc7-7301-40d8-8988-bf8ce8dabf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411d55c4-c8a5-4a73-87ce-fd53fb1d483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:37 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Volume d3479006-e627-4b70-8ed6-4396614b41e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3479006-e627-4b70-8ed6-4396614b41e2', 'volume_size': 1} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592612856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3479006-e627-4b70-8ed6-4396614b41e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:37Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Creating volume d3479006-e627-4b70-8ed6-4396614b41e2 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:37 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-3dbca47b-86b3-4b73-b716-fc5934f9b262 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-d3c8e6ca-e32f-4680-9743-a332303cf988-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:37 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 1073741824 Nov 05 16:26:37 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-34f8598d-5073-4898-8e6c-2a534e563a18-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Lock "cinder-34f8598d-5073-4898-8e6c-2a534e563a18-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-34f8598d-5073-4898-8e6c-2a534e563a18" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-34f8598d-5073-4898-8e6c-2a534e563a18" acquired by "delete_volume" :: waited 0.025s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcdfcaa-163e-4fa9-9c10-d75d34066731]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:37 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 1073741824" returned: 0 in 0.490s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:37 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 Nov 05 16:26:37 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:37 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 Nov 05 16:26:37 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:38 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2" returned: 0 in 0.258s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411d55c4-c8a5-4a73-87ce-fd53fb1d483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3479006-e627-4b70-8ed6-4396614b41e2', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6da3619-fde0-41c4-8ece-4bf4c5d3e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:38 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Volume volume-d3479006-e627-4b70-8ed6-4396614b41e2 (d3479006-e627-4b70-8ed6-4396614b41e2): created successfully Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6da3619-fde0-41c4-8ece-4bf4c5d3e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (493c570c-22ef-45ed-b74f-66cde67ff3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7b3af0c3-fe8e-4f63-bf5d-35c1ef3cde41 tempest-ProjectReaderTests-2018227741 None] Created volume successfully. Nov 05 16:26:38 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18" returned: 0 in 0.402s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:38 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18 Nov 05 16:26:38 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:38 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-34f8598d-5073-4898-8e6c-2a534e563a18" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-34f8598d-5073-4898-8e6c-2a534e563a18" released by "delete_volume" :: held 0.715s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Created reservations ['1a37daf0-f4bd-4821-92af-d3ce73baa7c7', 'a6d4e986-372d-4827-aac9-cb1e4aa08dd5', '699d846a-001c-4352-bc71-05e9ecaba30f', '9f116a9a-0b43-4757-b086-560f7b1260d7'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:38 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:38 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:38 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:38 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:26:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ab203e51-b10c-48c2-a65c-ecaffd008f5a tempest-ProjectMemberTests-1442965469 None] Lock "cinder-34f8598d-5073-4898-8e6c-2a534e563a18-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (0add8b14-09dd-4cd4-a887-4a614e8d21ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082682a3-0385-4664-8355-a9fdfc1108d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-d3479006-e627-4b70-8ed6-4396614b41e2-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082682a3-0385-4664-8355-a9fdfc1108d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467298836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061658d1-dac0-4e2c-add5-95590a56c0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:39Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29581307-f01f-49de-9104-edecb4616f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29581307-f01f-49de-9104-edecb4616f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ea7ae9-2db7-4ec4-8443-98f0d86ee2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ea7ae9-2db7-4ec4-8443-98f0d86ee2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061658d1-dac0-4e2c-add5-95590a56c0ed', 'volume_name': 'volume-061658d1-dac0-4e2c-add5-95590a56c0ed', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1feefd-ad3c-446a-bd6e-c115af1413f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1feefd-ad3c-446a-bd6e-c115af1413f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcd5761-f69f-4e51-9761-3854bf63176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:39 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Volume 061658d1-dac0-4e2c-add5-95590a56c0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061658d1-dac0-4e2c-add5-95590a56c0ed', 'volume_size': 1} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467298836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061658d1-dac0-4e2c-add5-95590a56c0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:39Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Creating volume 061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:39 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Lock "cinder-d3479006-e627-4b70-8ed6-4396614b41e2-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:39 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed 1073741824 Nov 05 16:26:39 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-quobyte-d3479006-e627-4b70-8ed6-4396614b41e2" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-d3479006-e627-4b70-8ed6-4396614b41e2" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3583e8-565c-4663-8204-e9ff933c1159]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:39 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 Nov 05 16:26:39 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:39 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed 1073741824" returned: 0 in 0.438s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:39 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:39 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed Nov 05 16:26:39 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:39 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2 Nov 05 16:26:39 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:40 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed" returned: 0 in 0.253s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcd5761-f69f-4e51-9761-3854bf63176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061658d1-dac0-4e2c-add5-95590a56c0ed', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a8d631-be49-4d6b-8b71-d8334b6e24d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:40 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-d3479006-e627-4b70-8ed6-4396614b41e2" returned: 0 in 0.258s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:40 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Volume volume-061658d1-dac0-4e2c-add5-95590a56c0ed (061658d1-dac0-4e2c-add5-95590a56c0ed): created successfully Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a8d631-be49-4d6b-8b71-d8334b6e24d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (0add8b14-09dd-4cd4-a887-4a614e8d21ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-d3479006-e627-4b70-8ed6-4396614b41e2" released by "delete_volume" :: held 0.712s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:40 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d40f7082-4072-4c75-9687-1052906cc02b tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Created reservations ['9226538f-6eb5-4864-a96b-19535961b0fc', '336ef9b3-a9bf-4411-9905-4709c265f83e', '50cbea14-8760-4bec-9608-ff1609c19092', '4c18483e-6d69-4af3-ad35-837c9b593323'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:40 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:40 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 of volume 061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[98512ffd-5018-411f-bca2-e39e7e8f259c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:40 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.270s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:40 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Deleted volume successfully. Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-bf96e888-0a01-4c0a-a54b-bc7eb52db85b tempest-ProjectReaderTests-2018227741 None] Lock "cinder-d3479006-e627-4b70-8ed6-4396614b41e2-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:40 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed Nov 05 16:26:40 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:40 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed" returned: 0 in 0.401s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:41 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 1G Nov 05 16:26:41 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (d40594d9-edba-4255-8ede-14e61b09fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4138099-ae83-40c9-bf4e-5a0478b7440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4138099-ae83-40c9-bf4e-5a0478b7440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804339727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a51de1-0a07-43a2-ac15-a15cb4f1fe5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:41Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f4112c-f67d-4603-a921-d4892f8365f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f4112c-f67d-4603-a921-d4892f8365f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9efa79-a3a2-4349-9fa9-09300013b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9efa79-a3a2-4349-9fa9-09300013b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a51de1-0a07-43a2-ac15-a15cb4f1fe5c', 'volume_name': 'volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3545c4d-c6f7-443b-bf3f-ea6945317543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3545c4d-c6f7-443b-bf3f-ea6945317543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2021a0-3f12-475f-98f1-a192ae22b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:41 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Volume 72a51de1-0a07-43a2-ac15-a15cb4f1fe5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c', 'volume_size': 1} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:41 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 1G" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-061658d1-dac0-4e2c-add5-95590a56c0ed -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:41 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-061658d1-dac0-4e2c-add5-95590a56c0ed -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 Nov 05 16:26:41 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:41 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-061658d1-dac0-4e2c-add5-95590a56c0ed -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" returned: 0 in 0.289s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:41 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 is being set with open permissions: ugo+rw Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:41 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 Nov 05 16:26:41 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:41 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:41 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.info Nov 05 16:26:41 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:42 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.info" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:42 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.info is being set with open permissions: ugo+rw Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:42 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.info Nov 05 16:26:42 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:42 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.info" returned: 0 in 0.254s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804339727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a51de1-0a07-43a2-ac15-a15cb4f1fe5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee09488ff6245458222fd5008d81c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:41Z,use_quota=True,user_id='b85470217899416aa9bbd0e6432e9b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Creating volume 72a51de1-0a07-43a2-ac15-a15cb4f1fe5c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:42 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:42 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c 1073741824 Nov 05 16:26:42 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-d3938572-95c0-4e04-8fdc-46abafda5f00 tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-f645c4b7-f6fe-4eb1-a4f6-5631cde01d63-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-f645c4b7-f6fe-4eb1-a4f6-5631cde01d63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-061658d1-dac0-4e2c-add5-95590a56c0ed" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-061658d1-dac0-4e2c-add5-95590a56c0ed" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 of volume 061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9587b4ab-675a-4ffb-a87b-ca373f9aa5d9]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:42 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 Nov 05 16:26:42 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:42 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c 1073741824" returned: 0 in 0.431s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:42 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c Nov 05 16:26:42 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:43 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" returned: 0 in 0.414s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-061658d1-dac0-4e2c-add5-95590a56c0ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8816ac19-23e2-4c80-b966-685344f5e899]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:43 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c" returned: 0 in 0.265s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2021a0-3f12-475f-98f1-a192ae22b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176ecce-31ab-4d5a-87ed-89feeb27bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:43 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Volume volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c (72a51de1-0a07-43a2-ac15-a15cb4f1fe5c): created successfully Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176ecce-31ab-4d5a-87ed-89feeb27bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Flow 'volume_create_manager' (d40594d9-edba-4255-8ede-14e61b09fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:43 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-370b480b-1c78-4937-8933-30afa21e02d2 tempest-ProjectReaderTests-2018227741 None] Created volume successfully. Nov 05 16:26:43 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed Nov 05 16:26:43 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:43 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:43 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 Nov 05 16:26:43 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:43 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" returned: 0 in 0.334s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:43 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63 Nov 05 16:26:43 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:44 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed.f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-f645c4b7-f6fe-4eb1-a4f6-5631cde01d63" released by "_delete_snapshot" :: held 1.497s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-061658d1-dac0-4e2c-add5-95590a56c0ed" released by "delete_snapshot" :: held 1.527s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "cinder-quobyte-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[350960db-96af-41d7-9813-c8069ad88162]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Created reservations ['4f9d0fed-2c35-4be3-94ca-c5d5296c079a', 'a94a5067-4404-403b-b99d-fa86c15f075a', '56d4433d-d6f2-4c4e-a6b0-7ef7a3a4a2ff', '5357f88c-d3c0-4f2a-a397-28663cc60447'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:44 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-67943114-3b55-4c5d-a41c-dbb390119289 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-f645c4b7-f6fe-4eb1-a4f6-5631cde01d63-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:44 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c Nov 05 16:26:44 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:44 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c" returned: 0 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:44 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c Nov 05 16:26:44 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-061658d1-dac0-4e2c-add5-95590a56c0ed-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Lock "cinder-061658d1-dac0-4e2c-add5-95590a56c0ed-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-061658d1-dac0-4e2c-add5-95590a56c0ed" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-061658d1-dac0-4e2c-add5-95590a56c0ed" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:44 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c" returned: 0 in 0.283s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fc53eb-d5f1-42ba-90fb-08c593d17151]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-quobyte-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c" released by "delete_volume" :: held 0.698s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Created reservations ['9cf12c5a-c0dd-41d4-8e35-e1b6e9350ffc', '130fc396-0d5e-4012-8aa2-7710d3f1cac2', '95c498ae-2425-45aa-9215-14fc83e226b0', '6088366f-efa1-4c5d-a62b-9ac56158b4d2'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:45 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed Nov 05 16:26:45 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:45 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:45 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:45 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:45 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.263s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed" returned: 0 in 0.396s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:45 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Deleted volume successfully. Nov 05 16:26:45 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed Nov 05 16:26:45 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-20e93595-0263-437d-80a5-33dd3e9d3509 tempest-ProjectReaderTests-2018227741 None] Lock "cinder-72a51de1-0a07-43a2-ac15-a15cb4f1fe5c-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:45 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-061658d1-dac0-4e2c-add5-95590a56c0ed" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-061658d1-dac0-4e2c-add5-95590a56c0ed" released by "delete_volume" :: held 0.712s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Created reservations ['5b7a93af-4ce5-45c4-af8f-76193104cbe8', 'f40ee65e-62d7-4004-8d91-d9f803352323', 'bfa0fcd6-27f3-4495-bab1-9ed08f18e0ce', 'ee2447b8-b1fc-4ae5-9355-d21e7e797b0d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:45 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:45 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:46 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.256s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-2954759c-de93-4560-ae95-5ffb919b59ae tempest-ProjectMemberTests-1442965469 None] Lock "cinder-061658d1-dac0-4e2c-add5-95590a56c0ed-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (3abf16e0-0c6b-4b31-85bc-847c60ce25d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37a51a6-4cc6-4325-8d07-620b1b3a72b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37a51a6-4cc6-4325-8d07-620b1b3a72b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547576842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f8ccc3-cd1d-4589-a326-44fb76dc425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:46Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcfa1d3-8afd-4944-8d55-55a20fd4607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcfa1d3-8afd-4944-8d55-55a20fd4607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8290437-a024-4aa4-904d-e75e775638e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8290437-a024-4aa4-904d-e75e775638e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f8ccc3-cd1d-4589-a326-44fb76dc425e', 'volume_name': 'volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6162c6-72a2-4fe6-950a-8c5f4af2c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6162c6-72a2-4fe6-950a-8c5f4af2c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a496b34-19dc-49e6-b108-e4ec0f569bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:46 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Volume c9f8ccc3-cd1d-4589-a326-44fb76dc425e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e', 'volume_size': 1} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547576842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f8ccc3-cd1d-4589-a326-44fb76dc425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:46Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Creating volume c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:46 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:46 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e 1073741824 Nov 05 16:26:46 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:47 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e 1073741824" returned: 0 in 0.494s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:47 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e Nov 05 16:26:47 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:47 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a496b34-19dc-49e6-b108-e4ec0f569bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5d8a8d-9ed7-4682-ba42-f5377994350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:47 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Volume volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e (c9f8ccc3-cd1d-4589-a326-44fb76dc425e): created successfully Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5d8a8d-9ed7-4682-ba42-f5377994350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:47 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (3abf16e0-0c6b-4b31-85bc-847c60ce25d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:47 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3c57a07b-0f70-48e5-b703-e4b09e66d474 tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:26:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:48 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot 2ae24bda-d78a-4560-ab2a-4d759975cb9f of volume c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:26:48 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[12656e6d-f56a-413c-a5f5-10f365ffff61]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:48 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:48 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e Nov 05 16:26:48 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:49 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" returned: 0 in 0.355s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:49 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f 1G Nov 05 16:26:49 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:49 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f 1G" returned: 0 in 0.383s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:49 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f Nov 05 16:26:49 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:49 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:49 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f is being set with open permissions: ugo+rw Nov 05 16:26:49 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:49 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f Nov 05 16:26:49 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:50 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f" returned: 0 in 0.239s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:50 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.info Nov 05 16:26:50 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:50 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:50 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:50 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.info" returned: 0 in 0.267s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:50 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.info is being set with open permissions: ugo+rw Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:50 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.info Nov 05 16:26:50 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:50 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:26:50 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.info" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:50 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fe456648-e3ab-4396-b017-6e5c5fcaecc3 tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-2ae24bda-d78a-4560-ab2a-4d759975cb9f-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-2ae24bda-d78a-4560-ab2a-4d759975cb9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-2ae24bda-d78a-4560-ab2a-4d759975cb9f" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-2ae24bda-d78a-4560-ab2a-4d759975cb9f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot 2ae24bda-d78a-4560-ab2a-4d759975cb9f of volume c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdf6a0e-46d8-45d4-85f7-b761e18cf099]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:51 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f Nov 05 16:26:51 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:51 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f" returned: 0 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[50751233-cfb5-40fe-b650-d55012e79722]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:51 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e Nov 05 16:26:51 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:51 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" returned: 0 in 0.350s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:51 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f Nov 05 16:26:51 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:51 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f" returned: 0 in 0.338s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:51 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:52 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f Nov 05 16:26:52 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:52 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:52 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e.2ae24bda-d78a-4560-ab2a-4d759975cb9f" returned: 0 in 0.251s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-2ae24bda-d78a-4560-ab2a-4d759975cb9f" released by "_delete_snapshot" :: held 1.387s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" released by "delete_snapshot" :: held 1.409s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:52 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Created reservations ['11665ef6-a87f-42ff-9afc-ebb23a6d15df', 'b9efa02c-bba6-42ae-82d5-ee635bbb04d6', '0a3f5889-47ae-4172-a5b4-5fbacd80914c', '71d31d91-1459-4c16-8734-96043c5ee098'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:52 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:26:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-93a60037-6d0d-409d-a121-31a6c1b73452 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-2ae24bda-d78a-4560-ab2a-4d759975cb9f-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:52 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-c9f8ccc3-cd1d-4589-a326-44fb76dc425e-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Lock "cinder-c9f8ccc3-cd1d-4589-a326-44fb76dc425e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0115fc-43a1-4f8d-8e53-fce315f58227]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:53 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e Nov 05 16:26:53 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:53 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" returned: 0 in 0.363s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:53 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e Nov 05 16:26:53 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:53 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-c9f8ccc3-cd1d-4589-a326-44fb76dc425e" released by "delete_volume" :: held 0.668s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Created reservations ['fc2b5372-514c-4456-8ef2-430b3f2d0b84', 'b97912a4-173b-4ad8-a189-3f32f5b88a27', '48df15b6-4846-42a0-9cd4-d6f9b009009b', '01eb085f-329e-412a-aa39-5b3487b4b0ab'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:53 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:53 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:26:53 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:54 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:26:54 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-f84fac58-9bc9-4b81-aa27-fdfa77b83f6f tempest-ProjectMemberTests-1442965469 None] Lock "cinder-c9f8ccc3-cd1d-4589-a326-44fb76dc425e-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (26fb1bd3-600f-44a8-bbdf-62a09696d90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b6425f-3e17-4918-8bc3-12801d20dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b6425f-3e17-4918-8bc3-12801d20dc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162369119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3ad67f-4869-4c61-8b7c-700d23ef937e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:55Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9932ff0-8e60-40e4-80fe-f4a59a2bca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9932ff0-8e60-40e4-80fe-f4a59a2bca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd6838d-b3de-4f62-bd24-f926d8603c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd6838d-b3de-4f62-bd24-f926d8603c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a3ad67f-4869-4c61-8b7c-700d23ef937e', 'volume_name': 'volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97dc2d3-e4f4-43f6-bb4c-700e24c68730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97dc2d3-e4f4-43f6-bb4c-700e24c68730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcca778-f54b-4e6a-8b6e-36435d2543a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:54 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Volume 1a3ad67f-4869-4c61-8b7c-700d23ef937e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e', 'volume_size': 1} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162369119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a3ad67f-4869-4c61-8b7c-700d23ef937e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:26:55Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Creating volume 1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:26:54 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:26:54 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:54 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e 1073741824 Nov 05 16:26:54 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:55 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e 1073741824" returned: 0 in 0.403s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:55 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e Nov 05 16:26:55 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:55 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcca778-f54b-4e6a-8b6e-36435d2543a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3ff9a-7657-4eae-8f4c-9696075b4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:26:55 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Volume volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e (1a3ad67f-4869-4c61-8b7c-700d23ef937e): created successfully Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f3ff9a-7657-4eae-8f4c-9696075b4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (26fb1bd3-600f-44a8-bbdf-62a09696d90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:26:55 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7f600fa7-3244-473c-bc3c-09a161b2f52f tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot 61a7122a-c644-4353-b327-14be6e15d4ce of volume 1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f8ffac-454a-40ee-993c-d091ec6018e0]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:55 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:55 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e Nov 05 16:26:55 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:56 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e" returned: 0 in 0.363s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:56 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce 1G Nov 05 16:26:56 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:56 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce 1G" returned: 0 in 0.378s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:56 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce Nov 05 16:26:56 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:56 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce" returned: 0 in 0.278s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:56 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce is being set with open permissions: ugo+rw Nov 05 16:26:56 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:56 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce Nov 05 16:26:56 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:57 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:57 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.info Nov 05 16:26:57 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:57 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.info" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:57 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.info is being set with open permissions: ugo+rw Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:57 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.info Nov 05 16:26:57 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:57 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.info" returned: 0 in 0.240s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:26:57 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f27d2841-f274-4af4-a23d-829235cbd9ff tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-61a7122a-c644-4353-b327-14be6e15d4ce-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-61a7122a-c644-4353-b327-14be6e15d4ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-1a3ad67f-4869-4c61-8b7c-700d23ef937e" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-1a3ad67f-4869-4c61-8b7c-700d23ef937e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-61a7122a-c644-4353-b327-14be6e15d4ce" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-61a7122a-c644-4353-b327-14be6e15d4ce" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot 61a7122a-c644-4353-b327-14be6e15d4ce of volume 1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22b5378-1a67-4cc3-9e6c-0f217efdfc06]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:57 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:58 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce Nov 05 16:26:58 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:58 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce" returned: 0 in 0.355s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:58 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:26:58 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b97e4-36d6-48ed-90e1-83597e12518c]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:26:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:58 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e Nov 05 16:26:58 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:58 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e" returned: 0 in 0.348s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:58 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:58 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce Nov 05 16:26:58 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:59 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce" returned: 0 in 0.328s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:26:59 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce Nov 05 16:26:59 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:26:59 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Nov 05 16:26:59 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e.61a7122a-c644-4353-b327-14be6e15d4ce" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:26:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-61a7122a-c644-4353-b327-14be6e15d4ce" released by "_delete_snapshot" :: held 1.377s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-1a3ad67f-4869-4c61-8b7c-700d23ef937e" released by "delete_snapshot" :: held 1.397s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:26:59 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Created reservations ['971a2cbe-41f8-4a95-ad62-a62098f8afb6', '701865d0-afc3-42d9-af61-06d024059483', 'cb08a70b-5e46-42a8-bfc7-cb16defdf554', '1c44c3ad-c778-4377-ad99-fbf6c7856e4e'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:26:59 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:26:59 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-58fc7d6e-83d4-4fb0-a134-d760e6d87e98 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-61a7122a-c644-4353-b327-14be6e15d4ce-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-1a3ad67f-4869-4c61-8b7c-700d23ef937e-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-1a3ad67f-4869-4c61-8b7c-700d23ef937e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-1a3ad67f-4869-4c61-8b7c-700d23ef937e" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-1a3ad67f-4869-4c61-8b7c-700d23ef937e" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c08a086-4a92-464c-9814-088cc949c267]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:00 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e Nov 05 16:27:00 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:00 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:00 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e Nov 05 16:27:00 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:00 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-1a3ad67f-4869-4c61-8b7c-700d23ef937e" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-1a3ad67f-4869-4c61-8b7c-700d23ef937e" released by "delete_volume" :: held 0.657s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Created reservations ['9e3e8975-24c8-4d0f-b554-b9b89fcc95b7', '3d066c16-dc38-4dea-b280-384baee868a5', 'a2b0823a-9c50-42e9-85fe-4b209adf7c03', '6ef4f4e2-160f-4f88-a353-f4e40885a52d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:00 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:00 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:00 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:01 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:01 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-672e2715-a53c-4761-b1ea-8782948752e0 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-1a3ad67f-4869-4c61-8b7c-700d23ef937e-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (93d6b78a-dc00-4c0e-9098-0dcc186ac7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4c8ccf-fc6c-4c86-84f5-879e85b4de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4c8ccf-fc6c-4c86-84f5-879e85b4de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-663485254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed26352b-a45e-46e1-8548-080700f1793e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:02Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799c1a5c-fbf5-4189-9ba9-045e02a464fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799c1a5c-fbf5-4189-9ba9-045e02a464fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c31aab-62f4-4534-ad3b-e21d71c88b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c31aab-62f4-4534-ad3b-e21d71c88b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed26352b-a45e-46e1-8548-080700f1793e', 'volume_name': 'volume-ed26352b-a45e-46e1-8548-080700f1793e', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff565f2-7927-476b-b637-4d736dc3a804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff565f2-7927-476b-b637-4d736dc3a804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d5400e-8926-4e5d-828f-d834b8ff6ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:01 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Volume ed26352b-a45e-46e1-8548-080700f1793e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed26352b-a45e-46e1-8548-080700f1793e', 'volume_size': 1} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-663485254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed26352b-a45e-46e1-8548-080700f1793e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45fb9ad84e489faecf721c34c88fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:02Z,use_quota=True,user_id='10d60f9e215b4fba8ed11e9cb73df4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Creating volume ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:27:01 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:27:01 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:01 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e 1073741824 Nov 05 16:27:01 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:02 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e 1073741824" returned: 0 in 0.404s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:02 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e Nov 05 16:27:02 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:02 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d5400e-8926-4e5d-828f-d834b8ff6ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed26352b-a45e-46e1-8548-080700f1793e', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2c5e80-3c18-4f77-a1ae-6750fc439560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:02 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Volume volume-ed26352b-a45e-46e1-8548-080700f1793e (ed26352b-a45e-46e1-8548-080700f1793e): created successfully Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2c5e80-3c18-4f77-a1ae-6750fc439560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Flow 'volume_create_manager' (93d6b78a-dc00-4c0e-9098-0dcc186ac7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:02 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-cc88c059-ec43-40fe-8618-c58a00c5f8d5 tempest-ProjectMemberTests-1442965469 None] Created volume successfully. Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Creating offline snapshot a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 of volume ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a806932-4ab4-481a-8a21-cbee9e12f7fb]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:02 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:02 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e Nov 05 16:27:02 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:03 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:03 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 1G Nov 05 16:27:03 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:03 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 1G" returned: 0 in 0.405s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed26352b-a45e-46e1-8548-080700f1793e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:03 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed26352b-a45e-46e1-8548-080700f1793e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 Nov 05 16:27:03 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:03 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed26352b-a45e-46e1-8548-080700f1793e -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" returned: 0 in 0.299s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:03 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 is being set with open permissions: ugo+rw Nov 05 16:27:03 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:03 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 Nov 05 16:27:03 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:04 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:04 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.info Nov 05 16:27:04 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:04 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.info" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:04 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.info is being set with open permissions: ugo+rw Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:04 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.info Nov 05 16:27:04 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:04 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.info" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:04 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-3149d6b0-ad79-4202-ba7d-c66c9495ba59 tempest-ProjectMemberTests-1442965469 None] Create snapshot completed successfully Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-a3bd90aa-3be7-434f-8c7a-1de4ce622cc6-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-a3bd90aa-3be7-434f-8c7a-1de4ce622cc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-ed26352b-a45e-46e1-8548-080700f1793e" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-ed26352b-a45e-46e1-8548-080700f1793e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:04 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Deleting offline snapshot a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 of volume ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] snapshot_file for this snap is: volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[558994da-f3a4-4da1-aa97-fd76491a03a3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:05 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 Nov 05 16:27:05 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:05 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" returned: 0 in 0.397s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed26352b-a45e-46e1-8548-080700f1793e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2530eb-d957-443f-bb8e-a722c99de7a7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:05 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e Nov 05 16:27:05 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:05 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e" returned: 0 in 0.362s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:05 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:05 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 Nov 05 16:27:05 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:06 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" returned: 0 in 0.333s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:06 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6 Nov 05 16:27:06 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:06 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:06 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e.a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-a3bd90aa-3be7-434f-8c7a-1de4ce622cc6" released by "_delete_snapshot" :: held 1.442s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-ed26352b-a45e-46e1-8548-080700f1793e" released by "delete_snapshot" :: held 1.465s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:06 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Created reservations ['f2876f26-502a-4792-8e74-734d5ee79443', '46af36be-ac0b-4ad1-8080-e23e205ddf82', '8d97d54a-6ae7-4ee4-9c93-4ff34b0135a7', '23f77280-bc2e-4833-a50d-b944f5f06df5'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:06 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Delete snapshot completed successfully. Nov 05 16:27:06 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-30bd322b-3f55-4e94-ac68-814414310fe9 tempest-ProjectMemberTests-1442965469 None] Lock "cinder-a3bd90aa-3be7-434f-8c7a-1de4ce622cc6-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-ed26352b-a45e-46e1-8548-080700f1793e-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Lock "cinder-ed26352b-a45e-46e1-8548-080700f1793e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Acquiring lock "cinder-quobyte-ed26352b-a45e-46e1-8548-080700f1793e" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-ed26352b-a45e-46e1-8548-080700f1793e" acquired by "delete_volume" :: waited 0.019s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b43dcc7-29b9-46ea-972b-c79245c1cd6d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:07 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e Nov 05 16:27:07 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:07 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:07 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e Nov 05 16:27:07 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:07 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-ed26352b-a45e-46e1-8548-080700f1793e" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Lock "cinder-quobyte-ed26352b-a45e-46e1-8548-080700f1793e" released by "delete_volume" :: held 0.655s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Created reservations ['fc1b44a7-7752-4eee-abfb-8fb45f2b1f61', '21a58ee4-0ea3-4291-bdd2-f180ac78aca7', 'c9ea273a-ddf4-4a49-96a7-f3c634863bec', '2aa6dae0-5eb1-4bec-a5c3-0dce6f426f3c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:07 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:07 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:07 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:08 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:08 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:08 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:08 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Deleted volume successfully. Nov 05 16:27:08 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b5a3b891-d2f4-4641-87f0-673b4932397e tempest-ProjectMemberTests-1442965469 None] Lock "cinder-ed26352b-a45e-46e1-8548-080700f1793e-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=157,cinder:INSERT=56,cinder:UPDATE=203,cinder:DELETE=17 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:INSERT=51,cinder:UPDATE=207,cinder:SELECT=136,cinder:DELETE=17 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (5e3b203d-5054-45a7-a9ec-bacfb827c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4770d5-bec5-4fae-a000-f3d148958aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4770d5-bec5-4fae-a000-f3d148958aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107200818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84e4b26-2540-481b-badf-fc1965da037c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:12Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcee0c40-acfe-4b58-bb3c-660efb6194bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcee0c40-acfe-4b58-bb3c-660efb6194bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f156f32-e579-4962-a1eb-ab77d8a8ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f156f32-e579-4962-a1eb-ab77d8a8ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84e4b26-2540-481b-badf-fc1965da037c', 'volume_name': 'volume-e84e4b26-2540-481b-badf-fc1965da037c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bef13c-13a1-4878-aabf-a2379d545b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bef13c-13a1-4878-aabf-a2379d545b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb78589-14d3-4fa7-95f0-f32964e7b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:11 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Volume e84e4b26-2540-481b-badf-fc1965da037c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84e4b26-2540-481b-badf-fc1965da037c', 'volume_size': 1} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107200818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84e4b26-2540-481b-badf-fc1965da037c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:12Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Creating volume e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:27:11 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:27:11 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:11 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c 1073741824 Nov 05 16:27:11 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:12 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c 1073741824" returned: 0 in 0.420s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:12 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c Nov 05 16:27:12 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:12 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c" returned: 0 in 0.240s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb78589-14d3-4fa7-95f0-f32964e7b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84e4b26-2540-481b-badf-fc1965da037c', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40da1d28-1ccb-40b1-9c73-25a1feb03a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:12 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Volume volume-e84e4b26-2540-481b-badf-fc1965da037c (e84e4b26-2540-481b-badf-fc1965da037c): created successfully Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40da1d28-1ccb-40b1-9c73-25a1feb03a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (5e3b203d-5054-45a7-a9ec-bacfb827c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:12 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0fafaa46-93cd-42fa-9840-dd7869ff05c0 tempest-ProjectReaderTests-1045591611 None] Created volume successfully. Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:12 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Creating offline snapshot ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 of volume e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:27:13 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf7ecc-e369-4ad5-b768-216a1defcecc]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:13 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c Nov 05 16:27:13 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:13 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c" returned: 0 in 0.377s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:13 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 1G Nov 05 16:27:13 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:13 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 1G" returned: 0 in 0.373s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:13 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84e4b26-2540-481b-badf-fc1965da037c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:13 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84e4b26-2540-481b-badf-fc1965da037c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 Nov 05 16:27:13 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:14 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84e4b26-2540-481b-badf-fc1965da037c -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" returned: 0 in 0.293s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:14 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 is being set with open permissions: ugo+rw Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:14 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 Nov 05 16:27:14 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:14 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:14 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.info Nov 05 16:27:14 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:14 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.info" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:14 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.info is being set with open permissions: ugo+rw Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:14 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.info Nov 05 16:27:14 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:14 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.info" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:14 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-f59f9a5f-a78d-483d-9ffc-81aba421cfa9 tempest-ProjectReaderTests-1045591611 None] Create snapshot completed successfully Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-e84e4b26-2540-481b-badf-fc1965da037c" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e84e4b26-2540-481b-badf-fc1965da037c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Deleting offline snapshot ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 of volume e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] snapshot_file for this snap is: volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da54b2e-5d95-4e9d-9167-95ea7d99d57b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:15 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 Nov 05 16:27:15 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:15 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" returned: 0 in 0.351s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84e4b26-2540-481b-badf-fc1965da037c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca625c-f7bf-4e10-8b4f-c996c369426b]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:15 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c Nov 05 16:27:15 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:16 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c" returned: 0 in 0.352s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:16 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 Nov 05 16:27:16 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:16 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" returned: 0 in 0.331s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:16 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46 Nov 05 16:27:16 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:16 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c.ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" returned: 0 in 0.240s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46" released by "_delete_snapshot" :: held 1.370s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e84e4b26-2540-481b-badf-fc1965da037c" released by "delete_snapshot" :: held 1.399s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Created reservations ['5b5abdde-a914-4017-bb56-6ee2d109754b', '84d214f7-52fe-43dc-b589-dfdca6403640', '5371b56c-d8ec-46f6-82ac-840cdb780a4b', 'd155e76c-8919-4908-b318-5e4acdb5a65d'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:16 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Delete snapshot completed successfully. Nov 05 16:27:16 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-8a57db87-df28-4753-9352-c9614ec75692 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-ecb2c5b8-984b-4ce7-b4c9-e7c8b28eef46-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-e84e4b26-2540-481b-badf-fc1965da037c-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Lock "cinder-e84e4b26-2540-481b-badf-fc1965da037c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-e84e4b26-2540-481b-badf-fc1965da037c" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e84e4b26-2540-481b-badf-fc1965da037c" acquired by "delete_volume" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4484e8c6-b94f-4394-8c96-af262a8900d7]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:17 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c Nov 05 16:27:17 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:17 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c" returned: 0 in 0.360s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:17 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c Nov 05 16:27:17 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:18 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e84e4b26-2540-481b-badf-fc1965da037c" returned: 0 in 0.253s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e84e4b26-2540-481b-badf-fc1965da037c" released by "delete_volume" :: held 0.673s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Created reservations ['d71e1276-02c7-4136-a47c-8e2b63c71012', '6386df7b-c1da-4485-a346-a50690ec84fe', 'a29c939e-4622-4e5b-8617-719d512065b2', '584161a2-1b34-40c2-8d3f-12253aeb7abf'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:18 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:18 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:18 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:18 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Deleted volume successfully. Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-b4dafa7d-00f5-4e5c-ac48-f74178d1d04e tempest-ProjectReaderTests-1045591611 None] Lock "cinder-e84e4b26-2540-481b-badf-fc1965da037c-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (a378e978-dc60-4547-b064-74fce66c9b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c56df6e-0453-4aec-945e-8bb6b29d6027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c56df6e-0453-4aec-945e-8bb6b29d6027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055263583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e79d396-70fc-48e4-8a7b-de3b3c20b49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:19Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73abb843-44e5-46ef-bfd1-e1091329ffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73abb843-44e5-46ef-bfd1-e1091329ffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d5f7d9-212a-424b-88d5-4835bd68bb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d5f7d9-212a-424b-88d5-4835bd68bb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e79d396-70fc-48e4-8a7b-de3b3c20b49d', 'volume_name': 'volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d708c3f6-24c4-47b9-9ce7-8b4417f11b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d708c3f6-24c4-47b9-9ce7-8b4417f11b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf64882-4c2f-40fd-a77b-e370edafe566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Volume 3e79d396-70fc-48e4-8a7b-de3b3c20b49d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d', 'volume_size': 1} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055263583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e79d396-70fc-48e4-8a7b-de3b3c20b49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:19Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Creating volume 3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:27:19 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:19 devstack sudo[109604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d 1073741824 Nov 05 16:27:19 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:19 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d 1073741824" returned: 0 in 0.397s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:19 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d Nov 05 16:27:19 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:19 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" returned: 0 in 0.240s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf64882-4c2f-40fd-a77b-e370edafe566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5baa0c-e1f9-453e-be7e-b7513cd5d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:19 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Volume volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d (3e79d396-70fc-48e4-8a7b-de3b3c20b49d): created successfully Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5baa0c-e1f9-453e-be7e-b7513cd5d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:19 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (a378e978-dc60-4547-b064-74fce66c9b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:19 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a3d115f4-886b-4a9d-ae8b-70f033d5cbcd tempest-ProjectReaderTests-1045591611 None] Created volume successfully. Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Creating offline snapshot b0101ca4-304a-43b2-a871-992f1ae69370 of volume 3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5723a345-57e7-4a17-a3b6-d9da3f8e7009]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:20 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d Nov 05 16:27:20 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:20 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:20 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 1G Nov 05 16:27:20 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:20 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 1G" returned: 0 in 0.387s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:20 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:20 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 Nov 05 16:27:20 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:21 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370" returned: 0 in 0.288s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:21 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 is being set with open permissions: ugo+rw Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:21 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 Nov 05 16:27:21 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:21 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:21 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.info Nov 05 16:27:21 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:21 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.info" returned: 0 in 0.245s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:21 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.info is being set with open permissions: ugo+rw Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:21 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.info Nov 05 16:27:21 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:21 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.info" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:21 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:21 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ae1c7541-a083-470c-a587-9baa26895036 tempest-ProjectReaderTests-1045591611 None] Create snapshot completed successfully Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-b0101ca4-304a-43b2-a871-992f1ae69370-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-b0101ca4-304a-43b2-a871-992f1ae69370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-b0101ca4-304a-43b2-a871-992f1ae69370" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-b0101ca4-304a-43b2-a871-992f1ae69370" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Deleting offline snapshot b0101ca4-304a-43b2-a871-992f1ae69370 of volume 3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] snapshot_file for this snap is: volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef418f9-aceb-4c92-b49b-d5feff9395dd]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:22 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 Nov 05 16:27:22 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:22 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370" returned: 0 in 0.349s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa4423-a542-4c47-9ee2-9aea67c620ec]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:22 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:22 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d Nov 05 16:27:22 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:23 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" returned: 0 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:23 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 Nov 05 16:27:23 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:23 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370" returned: 0 in 0.327s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:23 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370 Nov 05 16:27:23 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:23 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d.b0101ca4-304a-43b2-a871-992f1ae69370" returned: 0 in 0.244s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-b0101ca4-304a-43b2-a871-992f1ae69370" released by "_delete_snapshot" :: held 1.370s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" released by "delete_snapshot" :: held 1.391s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Created reservations ['de535344-e171-4d58-888e-a1e7e06a68b5', '861c5477-073a-4ecb-97ca-d82282460a9e', '10cde325-82bd-489b-98b7-478aafcdb6a3', 'ba082ccb-681a-4da9-9967-ab91c359d64c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:23 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Delete snapshot completed successfully. Nov 05 16:27:23 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-ff690aa2-a794-4ee5-9186-43adcc898778 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-b0101ca4-304a-43b2-a871-992f1ae69370-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-3e79d396-70fc-48e4-8a7b-de3b3c20b49d-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Lock "cinder-3e79d396-70fc-48e4-8a7b-de3b3c20b49d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b64110-2241-4750-b80c-5227ef228f4e]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:24 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d Nov 05 16:27:24 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:24 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" returned: 0 in 0.360s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:24 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:24 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d Nov 05 16:27:24 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:25 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" returned: 0 in 0.239s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-3e79d396-70fc-48e4-8a7b-de3b3c20b49d" released by "delete_volume" :: held 0.664s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Created reservations ['89008c26-b9fa-43b7-bc6b-fbafa5dda00b', '5014dac0-247e-447f-8428-1ab1db92dff8', '60a617cf-ce27-477c-9a8d-cfb66ca8ae38', 'b203ba71-9c18-48bc-bbcd-42a90d1fa58f'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:25 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:25 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:25 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.239s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Deleted volume successfully. Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-accae936-e6aa-4bb2-93f9-e8c22456486a tempest-ProjectReaderTests-1045591611 None] Lock "cinder-3e79d396-70fc-48e4-8a7b-de3b3c20b49d-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (58709b1a-7f54-48d0-b0ba-2ded5702977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b81b1ad-ba00-45b8-add0-01036378ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b81b1ad-ba00-45b8-add0-01036378ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002720592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37f3cf3-2668-45cb-9f98-7fb435cc6ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:26Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92dc479-fe3d-46b1-b174-653d612d56e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92dc479-fe3d-46b1-b174-653d612d56e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96632cf-65a6-42a1-a6df-595d6ed90651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96632cf-65a6-42a1-a6df-595d6ed90651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37f3cf3-2668-45cb-9f98-7fb435cc6ac8', 'volume_name': 'volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7064305-d0e8-4ccf-b79e-de0838a1f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7064305-d0e8-4ccf-b79e-de0838a1f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6c70b2-aee6-46df-af53-e14d4e8b4ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:25 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Volume f37f3cf3-2668-45cb-9f98-7fb435cc6ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8', 'volume_size': 1} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002720592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37f3cf3-2668-45cb-9f98-7fb435cc6ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:26Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Creating volume f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:27:25 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:27:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:26 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 1073741824 Nov 05 16:27:26 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:26 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 1073741824" returned: 0 in 0.406s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:26 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 Nov 05 16:27:26 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:26 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6c70b2-aee6-46df-af53-e14d4e8b4ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de769bd-b3b7-41f0-aedb-3600198cd6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:26 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Volume volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 (f37f3cf3-2668-45cb-9f98-7fb435cc6ac8): created successfully Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de769bd-b3b7-41f0-aedb-3600198cd6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:26 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (58709b1a-7f54-48d0-b0ba-2ded5702977e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:26 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-5990e382-2320-4f17-99fe-c29fa18b060e tempest-ProjectReaderTests-1045591611 None] Created volume successfully. Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Creating offline snapshot 293a4b18-0b16-464f-905f-358bb5d8de13 of volume f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f512a09-79cf-43c9-8390-747421a60eb2]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:27 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 Nov 05 16:27:27 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:27 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" returned: 0 in 0.363s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:27 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 1G Nov 05 16:27:27 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:27 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 1G" returned: 0 in 0.385s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:27 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 Nov 05 16:27:27 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:28 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13" returned: 0 in 0.287s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:28 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 is being set with open permissions: ugo+rw Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:28 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 Nov 05 16:27:28 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:28 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:28 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.info Nov 05 16:27:28 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:28 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.info" returned: 0 in 0.255s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:28 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.info is being set with open permissions: ugo+rw Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:28 devstack sudo[109699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.info Nov 05 16:27:28 devstack sudo[109699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:28 devstack sudo[109699]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.info" returned: 0 in 0.250s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:28 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e4c63682-047e-4596-970b-98575ca1c1a2 tempest-ProjectReaderTests-1045591611 None] Create snapshot completed successfully Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-293a4b18-0b16-464f-905f-358bb5d8de13-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-293a4b18-0b16-464f-905f-358bb5d8de13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-293a4b18-0b16-464f-905f-358bb5d8de13" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-293a4b18-0b16-464f-905f-358bb5d8de13" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Deleting offline snapshot 293a4b18-0b16-464f-905f-358bb5d8de13 of volume f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] snapshot_file for this snap is: volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a355cf8-1907-413f-abdb-f6e9f1eedc34]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:29 devstack sudo[109702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 Nov 05 16:27:29 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:29 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13" returned: 0 in 0.372s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f827f6-4d10-4b79-8797-0945de328e90]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:29 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 Nov 05 16:27:29 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:30 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" returned: 0 in 0.370s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:30 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 Nov 05 16:27:30 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:30 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13" returned: 0 in 0.323s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:30 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13 Nov 05 16:27:30 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:30 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8.293a4b18-0b16-464f-905f-358bb5d8de13" returned: 0 in 0.254s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-293a4b18-0b16-464f-905f-358bb5d8de13" released by "_delete_snapshot" :: held 1.414s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" released by "delete_snapshot" :: held 1.436s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Created reservations ['aac60c64-492d-430a-baab-831a0549601f', 'b46e3df1-7174-45a0-89d9-6eaadff87531', '16989fc1-524d-40e7-abbc-f59686346ed6', 'b3faa67e-2d2c-4865-8d27-b04290b2a090'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Delete snapshot completed successfully. Nov 05 16:27:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-272bee77-e35d-4c77-b4ed-d7c485f509a6 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-293a4b18-0b16-464f-905f-358bb5d8de13-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Lock "cinder-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[295713da-adc5-4206-8210-dd685242c06d]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:31 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 Nov 05 16:27:31 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:31 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" returned: 0 in 0.356s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:31 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:31 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8 Nov 05 16:27:31 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:32 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8" released by "delete_volume" :: held 0.663s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Created reservations ['99b06ef3-ad57-4d1b-a04a-b15d7a2df361', '915b6e49-0cb9-4767-93e2-52429cefba1b', 'b897d351-197f-4959-9adc-162fd2b1064c', '169c11da-8df3-4325-8582-4d0afea1879c'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:32 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:32 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:32 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:32 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Deleted volume successfully. Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-4627d1f3-e8cb-40af-8963-296008a5578b tempest-ProjectReaderTests-1045591611 None] Lock "cinder-f37f3cf3-2668-45cb-9f98-7fb435cc6ac8-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (ec1af577-d185-430c-a9e9-b5f0b60bcc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94618fa-cbfc-4ded-8581-cd272a570565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94618fa-cbfc-4ded-8581-cd272a570565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29310222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1867e50-4073-490d-8890-a9ffe4e09db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:33Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d58af5-73e1-4935-89bf-6504ed73511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d58af5-73e1-4935-89bf-6504ed73511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260668ee-41f3-4d33-8721-34e3d1bcc667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260668ee-41f3-4d33-8721-34e3d1bcc667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1867e50-4073-490d-8890-a9ffe4e09db9', 'volume_name': 'volume-e1867e50-4073-490d-8890-a9ffe4e09db9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a729ba0f-1893-4b13-9b98-0994467808b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:32 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a729ba0f-1893-4b13-9b98-0994467808b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b08606-01b6-41b1-abf0-f11a3874a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Volume e1867e50-4073-490d-8890-a9ffe4e09db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1867e50-4073-490d-8890-a9ffe4e09db9', 'volume_size': 1} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29310222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1867e50-4073-490d-8890-a9ffe4e09db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:33Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Creating volume e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:27:33 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:33 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 1073741824 Nov 05 16:27:33 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:33 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 1073741824" returned: 0 in 0.406s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:33 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 Nov 05 16:27:33 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:33 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9" returned: 0 in 0.247s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b08606-01b6-41b1-abf0-f11a3874a639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1867e50-4073-490d-8890-a9ffe4e09db9', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48528a79-6c7a-4639-a6e5-e3b5fe48514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:33 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Volume volume-e1867e50-4073-490d-8890-a9ffe4e09db9 (e1867e50-4073-490d-8890-a9ffe4e09db9): created successfully Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48528a79-6c7a-4639-a6e5-e3b5fe48514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:33 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (ec1af577-d185-430c-a9e9-b5f0b60bcc5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:33 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-eab1baec-0268-4430-ae5f-6d0e317e917a tempest-ProjectReaderTests-1045591611 None] Created volume successfully. Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Creating offline snapshot 2b7c4060-5530-4113-a016-4d49989ce46f of volume e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04f083c-3cd2-40b0-9d70-0b75e6be7c92]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:34 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 Nov 05 16:27:34 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:34 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9" returned: 0 in 0.352s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:34 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f 1G Nov 05 16:27:34 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:34 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f 1G" returned: 0 in 0.389s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:34 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1867e50-4073-490d-8890-a9ffe4e09db9 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:34 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1867e50-4073-490d-8890-a9ffe4e09db9 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f Nov 05 16:27:34 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:35 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1867e50-4073-490d-8890-a9ffe4e09db9 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f" returned: 0 in 0.283s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:35 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f is being set with open permissions: ugo+rw Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:35 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f Nov 05 16:27:35 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:35 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f" returned: 0 in 0.240s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:35 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.info Nov 05 16:27:35 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:35 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.info" returned: 0 in 0.249s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:35 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.info is being set with open permissions: ugo+rw Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:35 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.info Nov 05 16:27:35 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:35 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.info" returned: 0 in 0.232s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:35 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:35 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-ad5e1d63-49c7-4fd2-ab61-a45b6a73a5b8 tempest-ProjectReaderTests-1045591611 None] Create snapshot completed successfully Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-2b7c4060-5530-4113-a016-4d49989ce46f-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Lock "cinder-2b7c4060-5530-4113-a016-4d49989ce46f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-e1867e50-4073-490d-8890-a9ffe4e09db9" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e1867e50-4073-490d-8890-a9ffe4e09db9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-2b7c4060-5530-4113-a016-4d49989ce46f" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-2b7c4060-5530-4113-a016-4d49989ce46f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Deleting offline snapshot 2b7c4060-5530-4113-a016-4d49989ce46f of volume e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] snapshot_file for this snap is: volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[74611012-4256-4925-8fad-9e30754990e3]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:36 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f Nov 05 16:27:36 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:36 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f" returned: 0 in 0.358s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1867e50-4073-490d-8890-a9ffe4e09db9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c067618b-f23f-48b4-bafc-a5b4ba1a8494]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:36 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:36 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 Nov 05 16:27:36 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:37 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9" returned: 0 in 0.361s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:37 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f Nov 05 16:27:37 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:37 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f" returned: 0 in 0.333s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:37 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f Nov 05 16:27:37 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:37 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9.2b7c4060-5530-4113-a016-4d49989ce46f" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-2b7c4060-5530-4113-a016-4d49989ce46f" released by "_delete_snapshot" :: held 1.392s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e1867e50-4073-490d-8890-a9ffe4e09db9" released by "delete_snapshot" :: held 1.414s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Created reservations ['6088902c-0673-45ea-b21e-c1caffc30b2b', '2db4d0bf-aec0-46da-bbf3-6d79ef47498e', 'bdd39c06-7bb4-4b90-94be-ff818cb0148c', 'e2e74ad4-bc51-41af-9e9a-ecc269160ae4'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:37 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Delete snapshot completed successfully. Nov 05 16:27:37 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-a9ee8dbc-24b1-4942-a116-15848745e0af tempest-ProjectReaderTests-1045591611 None] Lock "cinder-2b7c4060-5530-4113-a016-4d49989ce46f-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-e1867e50-4073-490d-8890-a9ffe4e09db9-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-e1867e50-4073-490d-8890-a9ffe4e09db9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-e1867e50-4073-490d-8890-a9ffe4e09db9" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e1867e50-4073-490d-8890-a9ffe4e09db9" acquired by "delete_volume" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41374d0-1b0a-4482-92d3-bc6a230d5745]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:38 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 Nov 05 16:27:38 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:38 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9" returned: 0 in 0.348s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:38 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:38 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9 Nov 05 16:27:38 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:39 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-e1867e50-4073-490d-8890-a9ffe4e09db9" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-e1867e50-4073-490d-8890-a9ffe4e09db9" released by "delete_volume" :: held 0.650s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Created reservations ['0f9610df-3119-4676-8420-59e52e36ee63', '2c58a02b-418e-4e66-9478-bd2b292ce2f0', 'e98d78f2-cf76-4bfd-bd75-1f7ea248f6c1', '26557550-2fb7-4d6c-8f03-e7b3380b0de6'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:39 devstack sudo[109791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:39 devstack sudo[109791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:39 devstack sudo[109791]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.252s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:39 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Deleted volume successfully. Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-47ae993a-0bab-490d-8615-5578406275d2 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-e1867e50-4073-490d-8890-a9ffe4e09db9-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (8430efdd-ea78-4feb-a24e-8ff7e4dbb14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420f6323-33f5-4658-a304-312ab68c416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420f6323-33f5-4658-a304-312ab68c416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651430598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e0ece3-6293-4853-9b3c-503af8da0227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:40Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c4ee79-b8be-4f85-9fd0-54ccd7281ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c4ee79-b8be-4f85-9fd0-54ccd7281ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:39 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f337c44a-f46f-4f1e-b180-3314d3a4ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f337c44a-f46f-4f1e-b180-3314d3a4ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e0ece3-6293-4853-9b3c-503af8da0227', 'volume_name': 'volume-b6e0ece3-6293-4853-9b3c-503af8da0227', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96006ef3-6d32-409a-9838-3a572d144b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96006ef3-6d32-409a-9838-3a572d144b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0fa35d-18bf-45d7-af69-6d01c5f36f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:40 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Volume b6e0ece3-6293-4853-9b3c-503af8da0227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e0ece3-6293-4853-9b3c-503af8da0227', 'volume_size': 1} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651430598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e0ece3-6293-4853-9b3c-503af8da0227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d35b110064405a8e37e057b8512167',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:27:40Z,use_quota=True,user_id='4dcd6915acda4e6da0b5e4f2ff55c6b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Creating volume b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:27:40 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:40 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 1073741824 Nov 05 16:27:40 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:40 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 1073741824" returned: 0 in 0.405s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:40 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 Nov 05 16:27:40 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:40 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227" returned: 0 in 0.240s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0fa35d-18bf-45d7-af69-6d01c5f36f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e0ece3-6293-4853-9b3c-503af8da0227', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5151ae44-01b9-45e1-8e34-e94c6288f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:27:40 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Volume volume-b6e0ece3-6293-4853-9b3c-503af8da0227 (b6e0ece3-6293-4853-9b3c-503af8da0227): created successfully Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5151ae44-01b9-45e1-8e34-e94c6288f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:27:40 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Flow 'volume_create_manager' (8430efdd-ea78-4feb-a24e-8ff7e4dbb14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:27:40 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-a70d81a6-6845-493e-9ca7-56737fc5570c tempest-ProjectReaderTests-1045591611 None] Created volume successfully. Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Creating offline snapshot 58fe9a8e-dd29-41f2-acda-8a941bc878c7 of volume b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1388ce56-5265-4887-89dc-3d64d62f1217]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:41 devstack sudo[109803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 Nov 05 16:27:41 devstack sudo[109803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:41 devstack sudo[109803]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227" returned: 0 in 0.351s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:41 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 1G Nov 05 16:27:41 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:41 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 1G" returned: 0 in 0.388s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:41 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e0ece3-6293-4853-9b3c-503af8da0227 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:41 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e0ece3-6293-4853-9b3c-503af8da0227 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 Nov 05 16:27:41 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:42 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6e0ece3-6293-4853-9b3c-503af8da0227 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7" returned: 0 in 0.295s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:42 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 is being set with open permissions: ugo+rw Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:42 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 Nov 05 16:27:42 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:42 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7" returned: 0 in 0.243s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:42 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.info Nov 05 16:27:42 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:42 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.info" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:42 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.info is being set with open permissions: ugo+rw Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:42 devstack sudo[109825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.info Nov 05 16:27:42 devstack sudo[109825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:42 devstack sudo[109825]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.info" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:42 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:42 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-fad9e895-6f3d-4f85-9290-5e515201cd5f tempest-ProjectReaderTests-1045591611 None] Create snapshot completed successfully Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-58fe9a8e-dd29-41f2-acda-8a941bc878c7-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-58fe9a8e-dd29-41f2-acda-8a941bc878c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-b6e0ece3-6293-4853-9b3c-503af8da0227" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-b6e0ece3-6293-4853-9b3c-503af8da0227" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-58fe9a8e-dd29-41f2-acda-8a941bc878c7" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-58fe9a8e-dd29-41f2-acda-8a941bc878c7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Deleting offline snapshot 58fe9a8e-dd29-41f2-acda-8a941bc878c7 of volume b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] snapshot_file for this snap is: volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48bc206-6dd0-48c1-84ca-91729c9ea9db]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:43 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 Nov 05 16:27:43 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:43 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7" returned: 0 in 0.372s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6e0ece3-6293-4853-9b3c-503af8da0227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc074e-897e-400d-9f69-9558e5500a5a]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:43 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:43 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 Nov 05 16:27:43 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:44 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227" returned: 0 in 0.374s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:44 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 Nov 05 16:27:44 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:44 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7" returned: 0 in 0.333s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:44 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7 Nov 05 16:27:44 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:44 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227.58fe9a8e-dd29-41f2-acda-8a941bc878c7" returned: 0 in 0.248s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-58fe9a8e-dd29-41f2-acda-8a941bc878c7" released by "_delete_snapshot" :: held 1.428s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-b6e0ece3-6293-4853-9b3c-503af8da0227" released by "delete_snapshot" :: held 1.452s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Created reservations ['cf13aca9-7a46-48b8-9c57-6b2aa3f81654', 'f6130860-afd5-4773-94cd-6ebc44702927', '9091764f-1f1d-4819-8414-98750be6fce7', 'f5953d3e-031d-4ccd-b636-bec30fc91d74'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:44 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Delete snapshot completed successfully. Nov 05 16:27:44 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-0ab1eb9e-db14-4aaa-a8dd-56d427f820c7 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-58fe9a8e-dd29-41f2-acda-8a941bc878c7-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-b6e0ece3-6293-4853-9b3c-503af8da0227-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-b6e0ece3-6293-4853-9b3c-503af8da0227-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "cinder-quobyte-b6e0ece3-6293-4853-9b3c-503af8da0227" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-b6e0ece3-6293-4853-9b3c-503af8da0227" acquired by "delete_volume" :: waited 0.012s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1566040f-d95b-4f8e-87b2-4cabfba92fb4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:45 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 Nov 05 16:27:45 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:45 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227" returned: 0 in 0.359s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:45 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:45 devstack sudo[109893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227 Nov 05 16:27:45 devstack sudo[109893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:46 devstack sudo[109893]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b6e0ece3-6293-4853-9b3c-503af8da0227" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-quobyte-b6e0ece3-6293-4853-9b3c-503af8da0227" released by "delete_volume" :: held 0.655s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Created reservations ['7668875e-6895-4570-9386-36b34939c335', '6eb6d764-3bd4-49ce-bc94-a9c78be80b4c', 'e3c6525e-87d9-40a2-99e3-e3fc36729ae6', '3a23d441-2396-49e9-92a3-8fd4586258de'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:46 devstack sudo[109896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:46 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:46 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:46 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Deleted volume successfully. Nov 05 16:27:46 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-725a3837-6cbd-4538-8881-888c4c8d2826 tempest-ProjectReaderTests-1045591611 None] Lock "cinder-b6e0ece3-6293-4853-9b3c-503af8da0227-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:27:50 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:27:50 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:27:50 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.253s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:27:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 16:27:56 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=90,cinder:DELETE=11,cinder:SELECT=66,cinder:INSERT=25 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:27:56 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=73,cinder:INSERT=25,cinder:UPDATE=89,cinder:DELETE=4 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Flow 'volume_create_manager' (5beacc4d-f55f-463c-bd5b-f302db10aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6565cf63-c5e6-4287-968f-f89d2b823046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6565cf63-c5e6-4287-968f-f89d2b823046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2140412570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f62124-619f-412a-9520-c5e02e666018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9c9c19394e4154ade1c8363abf7df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:28:14Z,use_quota=True,user_id='f8bb0c5eb4b949d19d3c9fbc429990bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50846e3b-39ba-444d-8351-47ed25c588f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50846e3b-39ba-444d-8351-47ed25c588f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b117dfa-3ee7-4b82-821e-1f1ed1be2afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b117dfa-3ee7-4b82-821e-1f1ed1be2afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f62124-619f-412a-9520-c5e02e666018', 'volume_name': 'volume-43f62124-619f-412a-9520-c5e02e666018', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b23d0cf-450d-4c68-ab9e-5c31adcb6c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b23d0cf-450d-4c68-ab9e-5c31adcb6c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a282b33-bfc6-4a5c-8bad-28a9e1255a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:14 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Volume 43f62124-619f-412a-9520-c5e02e666018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f62124-619f-412a-9520-c5e02e666018', 'volume_size': 1} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2140412570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f62124-619f-412a-9520-c5e02e666018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9c9c19394e4154ade1c8363abf7df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:28:14Z,use_quota=True,user_id='f8bb0c5eb4b949d19d3c9fbc429990bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)}" {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Creating volume 43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:28:14 devstack cinder-volume[86924]: INFO cinder.volume.drivers.remotefs [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] casted to osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 1073741824 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:14 devstack sudo[109912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 1073741824 Nov 05 16:28:14 devstack sudo[109912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:14 devstack sudo[109912]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 1073741824" returned: 0 in 0.407s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:14 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:14 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 Nov 05 16:28:14 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:15 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018" returned: 0 in 0.246s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'} {{(pid=86924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a282b33-bfc6-4a5c-8bad-28a9e1255a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f62124-619f-412a-9520-c5e02e666018', 'volume_size': 1}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8252635d-a13f-4783-9314-c6a156d79d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:15 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Volume volume-43f62124-619f-412a-9520-c5e02e666018 (43f62124-619f-412a-9520-c5e02e666018): created successfully Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8252635d-a13f-4783-9314-c6a156d79d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Flow 'volume_create_manager' (5beacc4d-f55f-463c-bd5b-f302db10aa12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:28:15 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e01fd25d-59cd-4974-beb7-5fd7c2c5e690 tempest-SnapshotDependencyTests-2135851281 None] Created volume successfully. Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Creating offline snapshot 5b3d4a25-cd71-4901-9616-5ee2b44c4828 of volume 43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[70363a9f-2707-472d-84b4-071d8ee3bcd4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:28:15 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:15 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 Nov 05 16:28:15 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:16 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018" returned: 0 in 0.353s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 1G {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:16 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 1G Nov 05 16:28:16 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:16 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 1G" returned: 0 in 0.379s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f62124-619f-412a-9520-c5e02e666018 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:16 devstack sudo[109932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f62124-619f-412a-9520-c5e02e666018 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 Nov 05 16:28:16 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:16 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f62124-619f-412a-9520-c5e02e666018 -F qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828" returned: 0 in 0.283s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:16 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 is being set with open permissions: ugo+rw Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:16 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 Nov 05 16:28:16 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:16 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828" returned: 0 in 0.235s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:16 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:17 devstack sudo[109941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.info Nov 05 16:28:17 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:17 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.info" returned: 0 in 0.260s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:17 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.info is being set with open permissions: ugo+rw Nov 05 16:28:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.info {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:17 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.info Nov 05 16:28:17 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:17 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.info" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:17 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:17 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-e1d33e96-0a71-4b76-a5ae-68dbe3c69774 tempest-SnapshotDependencyTests-2135851281 None] Create snapshot completed successfully Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.flows.manager.create_volume [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Flow 'volume_create_manager' (3a604067-52f6-4d55-b9d4-9400bf616af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93297931-efed-48c7-93e5-703560be2258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93297931-efed-48c7-93e5-703560be2258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T15:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e49985-2412-489c-870b-8050a34878ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9c9c19394e4154ade1c8363abf7df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T15:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b3d4a25-cd71-4901-9616-5ee2b44c4828,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T15:28:18Z,use_quota=True,user_id='f8bb0c5eb4b949d19d3c9fbc429990bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03353cc0-0a42-439f-baa5-3ee962dcdfd1),volume_type_id=03353cc0-0a42-439f-baa5-3ee962dcdfd1)' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038cda86-8fcb-44d5-9131-127c022a8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038cda86-8fcb-44d5-9131-127c022a8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04d1f3-90bd-408e-917c-873e819286a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04d1f3-90bd-408e-917c-873e819286a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5e49985-2412-489c-870b-8050a34878ff', 'volume_name': 'volume-b5e49985-2412-489c-870b-8050a34878ff', 'volume_size': 1, 'snapshot_id': '5b3d4a25-cd71-4901-9616-5ee2b44c4828'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9c7670-04a6-487d-b84f-9c5942578453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9c7670-04a6-487d-b84f-9c5942578453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842647a7-e61b-4879-ade0-bdcd067dfdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:18 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Volume b5e49985-2412-489c-870b-8050a34878ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5e49985-2412-489c-870b-8050a34878ff', 'volume_size': 1, 'snapshot_id': '5b3d4a25-cd71-4901-9616-5ee2b44c4828'} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-quobyte-5b3d4a25-cd71-4901-9616-5ee2b44c4828-b5e49985-2412-489c-870b-8050a34878ff" by "_create_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-5b3d4a25-cd71-4901-9616-5ee2b44c4828-b5e49985-2412-489c-870b-8050a34878ff" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Creating volume b5e49985-2412-489c-870b-8050a34878ff from snapshot 5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Selected osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff as target Quobyte volume. {{(pid=86924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-quobyte-b5e49985-2412-489c-870b-8050a34878ff" by "_copy_volume_from_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-b5e49985-2412-489c-870b-8050a34878ff" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] snapshot: 5b3d4a25-cd71-4901-9616-5ee2b44c4828, volume: b5e49985-2412-489c-870b-8050a34878ff, {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c6f96-96ac-43fa-bd07-bcec61e339c8]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:18 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 Nov 05 16:28:18 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:18 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828" returned: 0 in 0.354s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f62124-619f-412a-9520-c5e02e666018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[da755d31-d98c-421d-98fd-ce78f202aba4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:28:18 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:18 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 Nov 05 16:28:18 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:19 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018" returned: 0 in 0.355s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 16:28:19 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Creating direct copy from snapshot {{(pid=86924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 16:28:19 devstack cinder-volume[86924]: DEBUG cinder.utils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Path /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff not found in is_blk_device check {{(pid=86924) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 16:28:19 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:19 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff Nov 05 16:28:19 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:25 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff" returned: 0 in 5.838s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.image.image_utils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Image conversion details: src /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff {{(pid=86924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:559}} Nov 05 16:28:25 devstack cinder-volume[86924]: INFO cinder.image.image_utils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Converted 1024.00 MB image at 175.38 MB/s Nov 05 16:28:25 devstack cinder-volume[86924]: WARNING cinder.volume.drivers.remotefs [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff is being set with open permissions: ugo+rw Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:25 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff Nov 05 16:28:25 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:25 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff" returned: 0 in 0.238s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-b5e49985-2412-489c-870b-8050a34878ff" released by "_copy_volume_from_snapshot" :: held 6.865s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-5b3d4a25-cd71-4901-9616-5ee2b44c4828-b5e49985-2412-489c-870b-8050a34878ff" released by "_create_volume_from_snapshot" :: held 6.920s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.935s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842647a7-e61b-4879-ade0-bdcd067dfdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e49985-2412-489c-870b-8050a34878ff', 'volume_size': 1, 'snapshot_id': '5b3d4a25-cd71-4901-9616-5ee2b44c4828'}' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56c601f-e2c7-4bb2-9fe2-95549fb46293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 16:28:25 devstack cinder-volume[86924]: INFO cinder.volume.flows.manager.create_volume [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Volume volume-b5e49985-2412-489c-870b-8050a34878ff (b5e49985-2412-489c-870b-8050a34878ff): created successfully Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56c601f-e2c7-4bb2-9fe2-95549fb46293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Flow 'volume_create_manager' (3a604067-52f6-4d55-b9d4-9400bf616af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 16:28:25 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-18562f46-5332-41d8-86ec-fa126a3b8c73 tempest-SnapshotDependencyTests-2135851281 None] Created volume successfully. Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-5b3d4a25-cd71-4901-9616-5ee2b44c4828-delete_snapshot" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-5b3d4a25-cd71-4901-9616-5ee2b44c4828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-quobyte-43f62124-619f-412a-9520-c5e02e666018" by "delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-43f62124-619f-412a-9520-c5e02e666018" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-quobyte-5b3d4a25-cd71-4901-9616-5ee2b44c4828" by "_delete_snapshot" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-5b3d4a25-cd71-4901-9616-5ee2b44c4828" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Deleting offline snapshot 5b3d4a25-cd71-4901-9616-5ee2b44c4828 of volume 43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] snapshot_file for this snap is: volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca2edb-e104-4721-aac4-47b736fb6f29]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:28:25 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:26 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 Nov 05 16:28:26 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:26 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828" returned: 0 in 0.342s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:26 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.remotefs [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f62124-619f-412a-9520-c5e02e666018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 16:28:26 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[847c89de-f309-43fc-9e31-ead09f539e46]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:28:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:26 devstack sudo[109979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 Nov 05 16:28:26 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:26 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018" returned: 0 in 0.513s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:26 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:26 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 Nov 05 16:28:26 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:27 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828" returned: 0 in 0.314s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:27 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828 Nov 05 16:28:27 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:27 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:27 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018.5b3d4a25-cd71-4901-9616-5ee2b44c4828" returned: 0 in 0.237s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-5b3d4a25-cd71-4901-9616-5ee2b44c4828" released by "_delete_snapshot" :: held 1.502s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-43f62124-619f-412a-9520-c5e02e666018" released by "delete_snapshot" :: held 1.525s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:27 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Created reservations ['491f2828-bd7d-43fc-b126-4373f2160495', '0b48294d-ba05-457d-bf28-8a8231280df6', '74ede45e-08d0-4c36-a56e-2306b16ebf71', 'ed24e561-5947-4289-862c-a2a5aad81c38'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:28:27 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Delete snapshot completed successfully. Nov 05 16:28:27 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-043264ba-d1bb-44f8-817a-bc7c55180cbf tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-5b3d4a25-cd71-4901-9616-5ee2b44c4828-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-43f62124-619f-412a-9520-c5e02e666018-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-43f62124-619f-412a-9520-c5e02e666018-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-quobyte-43f62124-619f-412a-9520-c5e02e666018" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-43f62124-619f-412a-9520-c5e02e666018" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7176236-7499-4735-8b50-75eab68b12f4]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:28 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 Nov 05 16:28:28 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:28 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018" returned: 0 in 0.355s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:28 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018 Nov 05 16:28:28 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:28 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-43f62124-619f-412a-9520-c5e02e666018" returned: 0 in 0.235s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-43f62124-619f-412a-9520-c5e02e666018" released by "delete_volume" :: held 0.650s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Created reservations ['cf47c370-07bd-4f8b-a253-c10d74b2a3d4', '2f91db81-c563-4c37-ad89-8df4d98b04e0', 'eb756857-ad72-4a70-b161-e616f297cf17', 'b61176f8-814f-41e8-a0f4-fcfcf18a2929'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:28 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:28 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:28:28 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:29 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.242s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:28:29 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Deleted volume successfully. Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-1936a97f-b68e-4526-8607-78a020a8d9ad tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-43f62124-619f-412a-9520-c5e02e666018-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-b5e49985-2412-489c-870b-8050a34878ff-delete_volume" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-b5e49985-2412-489c-870b-8050a34878ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "cinder-quobyte-b5e49985-2412-489c-870b-8050a34878ff" by "delete_volume" {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-b5e49985-2412-489c-870b-8050a34878ff" acquired by "delete_volume" :: waited 0.016s {{(pid=86924) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1160f59d-aa7f-4493-bc03-fd8e0c9a9aa5]: (4, 'qcow2') {{(pid=88544) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:29 devstack sudo[110004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff Nov 05 16:28:29 devstack sudo[110004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:29 devstack sudo[110004]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff" returned: 0 in 0.349s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:29 devstack sudo[110009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff Nov 05 16:28:29 devstack sudo[110009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:29 devstack sudo[110009]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3/volume-b5e49985-2412-489c-870b-8050a34878ff" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-quobyte-b5e49985-2412-489c-870b-8050a34878ff" released by "delete_volume" :: held 0.632s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.quota [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Created reservations ['8c6fed7f-c3b6-4f5c-a515-7b51984bbbc7', 'bc870ab3-446b-4ec0-bd08-1b6f46f4390a', 'ae24e072-1e3c-437c-83b7-53184139cc4c', '70591a44-fc14-4cdd-b20f-b47e417ba279'] {{(pid=86924) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:29 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:29 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:28:29 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:30 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:30 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.241s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:30 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:28:30 devstack cinder-volume[86924]: INFO cinder.volume.manager [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Deleted volume successfully. Nov 05 16:28:30 devstack cinder-volume[86924]: DEBUG cinder.coordination [None req-7ae8a95e-3b76-4442-a722-3887847c92e0 tempest-SnapshotDependencyTests-2135851281 None] Lock "cinder-b5e49985-2412-489c-870b-8050a34878ff-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86924) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 16:28:39 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:UPDATE=31,cinder:SELECT=25,cinder:INSERT=8 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:28:40 devstack cinder-volume[86924]: DEBUG dbcounter [-] [86924] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=5 {{(pid=86924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff': None} {{(pid=86924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG cinder.volume.drivers.quobyte [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-43940838-89a9-4213-b56b-b76172fc90ff'] {{(pid=86924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.lockutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 16:28:50 devstack sudo[110067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3 Nov 05 16:28:50 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 16:28:50 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG oslo_concurrency.processutils [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93db101c8bff4e749869848292d41fc3" returned: 0 in 0.237s {{(pid=86924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG cinder.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Notifying Schedulers of capabilities ... {{(pid=86924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG oslo_service.periodic_task [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] Running periodic task VolumeManager._thread_info {{(pid=86924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread count: 28 {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 16:28:50 devstack cinder-volume[86924]: DEBUG cinder.volume.manager [None req-e66f1566-0c0b-44ec-ac7e-9b3dd61353d5 None None] thread info: [<_MainThread(MainThread, started 134376894623872)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86924) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}